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a. 

^5 ! Abstract 

Operators conserving the indefinite scalar product on a Krein space (/C, J) are called 
. J-unitary. Such an operator T is defined to be S^-Fredholm if T — z 1 is Fredholm for all 

z on the unit circle S^, and essentially S^'^-gapped if there is only discrete spectrum on 

■ For paths in the S^-Fredholm operators an intersection index similar to the Conley-Zehnder 

■ index is introduced. The strict subclass of essentially S^-gapped operators has a countable 
number of components which can be distinguished by a homotopy invariant given by the 
signature of J restricted to the eigenspace of all eigenvalues on These concepts are 
illustrated by several examples. 
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1 Introduction and short overview 

O; 

A separable Krein space /C is a separable complex Hilbert space furnished with a so-called fun- 
damental symmetry which is a bounded operator J G B(/C) satisfying = 1 and J = J*. In 
this work the eigenspaces of J associated to the eigenvalues 1 and —1 are both supposed to be 
I isomorphic to a Hilbert space "H of dimension n. Thus /C = "H © "H and in this grading 

The interest is mainly on the case n = oo. The fundamental symmetry can also be seen as 
non-degenerate quadratic form of signature {n,n), and it induces a sesquilinear form on JC by 
& }C ^ 4>*Jip, also called an indefinite scalar product in this context. Here (p* denotes the 
linear functional associated to <p by the Riesz theorem, that is, the bra in the Dirac notation. A 
bounded operator T G ]B(/C) is called J-unitary if it conserves the indefinite scalar product, or 
equivalently, if it satisfies T*JT = J where T* denotes the usual Hilbert space adjoint in /C. A 
lot of basic facts about Krein spaces and J-unitary operators can be found in the monographs 
Bog, lAI] . for finite dimension n also in (YS[ IGLR| . The spectrum cr{T) of a J-unitary T has 



the §^-refiection property (j{T) = a{T) ^. Furthermore, the discrete spectrum on §^ (composed 
by normal eigenvalues, namely isolated eigenvalues of finite multiplicity) enjoys a remarkable 
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stability under perturbations as discovered by Krein [Krej and Gelfand and Lidskii [GLj in the 
finite dimensional case. Even eigenvalue collisions stay on whenever J is definite on the 
associated eigenspace. These results readily extend to the discrete spectrum in the infinite 
dimensional situation, and hold under certain further conditions also for essential spectrum (see 
Theorem 2.5.23 in [AI] ) . For the convenience of the reader and because it is relevant in the sequel, 
the main facts of stability theory for the discrete spectrum on §^ is reviewed in Section 13. 4[ 

This work is about Fredholm properties of J-unitary operators and homotopy invariants for 
associated operator classes. A J-unitary T is said to be §^-Fredholm if T — 2; 1 is a Fredholm 
operator for all 2; G S^. It is said to be essentially S^-gapped if there is only discrete spectrum 
on S^. The associated operator classes are denoted by F(/C, J) and G(/C, J). Both are open 
subsets of the J-unitary operators. The essentially S^-gapped J-unitaries form a strict subset 
of the §^-Fredholm operators, as is shown by an explicit example in Section 16.41 This example 
also shows that the property to be essentially §^-gapped is not stable under compact (even finite 
dimensional) perturbations, while the §^-Fredholm property clearly is compactly stable. 

The first main topic of the paper is the signature Sig(T) of an essentially §^-gapped J- 
unitary T. It is defined as the difference of the number of positive and negative eigenvalues 
of J restricted to the generalized eigenspace of all eigenvalues on (see Section 15. 2p . The 
signature is a homotopy invariant (Theorem [HI based on Krein stability theory) which is trivial 
in finite dimension, but in infinite dimension it permits to split the set G(/C, J) of essentially 
S^-gapped J-unitaries into disjoint open components, similar as the Fredholm index does for the 
Fredholm operators. It actually turns out to be not so simple to produce examples with non- 
trivial signature. The one given in Section 16.81 is the transfer operator of a half-space discrete 
magnetic Schodinger operator (Harper model). The signature is then equal to the number of 
edge modes weighted by the sign of the group velocity, and this latter number is known to be 
equal to a Chern number of the planar Harper model which in turn can take arbitrary values. It 
is to be hoped that further less intricate examples can be found in the future. It is reasonable 
to expect that there are also essentially M-gapped J-self-adjoint operators with a non-trivial 
signature invariant, but most likely they must be unbounded. 

The second main topic concerns the homotopy theory of paths in F(/C, J). This uses the 
construction (Theorem [5]) of a unitary operator V{T) on /C which can be associated to every 
J-unitary operator T because its graph is Lagrangian. It is explicitly given by 



One then has the equivalence of = 0, G /C, with V{T)(f) = (p (Theorem [H]). Furthermore, 
it turns out (Theorem [7j) that for an S^-Fredholm operator T, the point 1 is not in the essential 
spectrum of V{T). Hence for paths t Tf in the S^-Fredholm operators one can associate a 
spectral fiow of t 1— )■ V{Tt) through 1. Due to the above simple connection between the eigenvalue 
equations, this spectral fiow is an intersection index counting the weighted number of periodic 
solutions (pt of Tt<f>t = 4>t along the path (see Section 14. 2p . Actually, this index can also be 
understood as a Bott-Maslov index |Bot[ IMas] . albeit in an infinite dimensional space. More 
precisely, the unitary V{Tt) describes a Lagrangian subspace given by a certain adequate graph 
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of Tt, called the twisted graph. Therefore the above spectral flow can be considered as an infinite 
dimensional and modified version of the Conley-Zehnder index |CZ) . Because of this connection, 
this paper also contains in Sections 12 .31 and | 2 .41 a streamlined exposition of the Bott-Maslov index 
in infinite dimension. It is based on the use of unitaries to describe Lagrangian subspaces and 
the associated spectral flow similar as above. This approach does not use the Souriau map as 
prior works [Fur] . or several charts as the approach in [GPPj . 

The Bott-Maslov index and the above intersection number (of Conley-Zehnder type) is of 
little use if one has no information about the orientation of intersections (or equivalently the 
orientation of the crossings of the spectral flow). These orientations have to be studied for 
every given concrete path. A standard example is a linear Hamiltonian system (here in infinite 
dimension) for which there is some monotonicity (Theorem [T0|) that is actually at the basis of 
Sturm-Liouville oscillation theory jBotllLid"tlSB2| . Another example of a monotonous path counts 
the bound states of Schrodinger equations (see Section [6.2p . Furthermore, associated to every 
essentially §^-gapped J-unitary T there is a path t G [0, 2n) i— )■ e~**T in F(/C, J). Its intersection 
number is equal to the signature Sig(T) (Theorem [9]). This particular path is not monotonous, 
but the orientation of every crossing is given by the inertia of the corresponding eigenvalue of T 
on 

The author's initial motivation to study S^-Fredholm operators roots in applications to solid 
state physics systems. Just as for the Harper model alluded to above, the half-space transfer 
operators of periodic systems at energies in a gap of the full-space operator are S^-Fredholm 
operators. Each eigenvalue on the unit then corresponds to an edge mode (a peculiarity is that 
a continuum of eigenvalues on §^ corresponds to a fiat band of edge modes). These edge modes 
determine the boundary physics and systems for which it is non-trivial are called topological insu- 
lators. Therefore the signature (and its variants for classes of operators with further symmetries) 
of associated half-space transfer operators allows to distinguish between different topological in- 
sulators and its homotopy invariance also shows their structural stability. This application will 
be explored in a subsequent publication. 

Finally a few words on the structure and style of the present paper. It is basically self- 
contained with detailed proofs except for a few functional analytical facts resembled in the 
appendices. Of course, this makes the paper lengthy. However, a large part of the text is anyway 
necessary in order to introduce notations. Moreover, the author hopes that some readers may 
appreciate the concise treatment of some already known results and that experts can easily 
localize the new results. Section [2] concerns the basic geometry of Krein spaces and introduces 
the Bott-Maslov index. Section [3] recalls some important properties of J-unitaries including 
Krein stability analysis, and provides a detailed analysis of the unitary V{T) introduced above. 
Then Sections H] and [5] study the §^-Fredholm operators and essentially §^-gapped operators 
respectively, as well as the intersection number and signature. Finally Section E] provides examples 
to illustrate the general concepts of the paper. 

Notations: Vectors in Hilbert space are denoted hy v,w and 0, G /C; frames in /C (see 
Appendix [B] for a definition) are denoted by $, subspaces of K, (or in Appendix [B]) are 
described by £, T\ bounded operators on "H are described by small letters a,b,c,d G B('H), 
while bounded operators on /C rather by capital letters T,S,K G B(/C); unitary operators are 
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denoted by G U(7{) and U,V & U(/C); the star * is used for the passage to dual space in 
)C and "H (notably, (p*i(: denotes the scalar product of </>, -i/^ G JC) as well as the Hilbert space 
adjoint operator; norms of vectors and the operator norm are written as || . ||; finally the essential 
spectrum a^^s{T) is the spectrum of T without the discrete spectrum (thus in this work the 
essential spectrum is not given by those z for which T — 2;! is Fredholm). 



2 Geometry of subspaces of a Krein space 
2.1 Isotropy and orthogonality in Krein space 

This section recalls a few definitions {e.g. |Bog RI] ). then provides some formulas for projections 
in terms of frames used later on. 

Definition 1 Let S be a subspace of a Krein space (/C, J). 

(i) £ is called positive definite for J if and only if (f)*J(f) > for all (f) & S. Similarly, £ is called 
negative definite for J if (p* Jcf) < for all (f) E £. Moreover, £ is called definite if it is either 
positive or negative definite. 

(ii) £ is called degenerate for J if and only if there is a vector (p E £ such that (j)*Jilj = for all 
ip & £ ■ If £ is not degenerate, it is called non- degenerate. 

(iii) £ is called isotropic for J if and only if (f>*Jilj = for all (f),i/j E £ . 

(iv) A maximally isotropic subspace is called Lagrangian. 

(v) £ is called coisotropic for J if and only if (jfjip = for all ip E £ implies that (p E £. 

Let us point out that the maximality condition implies that Lagrangian subspaces are always 
closed. Note also that definite subspaces are clearly non-degenerate, but the inverse is not true. 

Definition 2 Let £ and £' be two subspaces of a Krein space (/C, J). 

(i) £ and £' are called J -orthogonal if and only if (p*Jip = for all (p E £ and tp E £' . We then 
also write £1. £' . 

(ii) Given £ , its J -orthogonal complement £^ is given by all vectors (p E K, satisfying (p* Jip = 
for all ip E £. 

(iii) If £ and £' are J -orthogonal and have trivial intersection, their sum is denoted by £+£'. 

Just as in euclidean geometry, J-orthogonal complements are closed. The following lemma 
collects a few direct connections with the notions above. 

Lemma 1 Let £ be a subspace of K,. 

(i) {£^)^ = £ 

(ii) £ is isotropic if and only if £ G £'^ 

(iii) £ is coisotropic if and only if £^ G £ 

(iv) £ is Lagrangian if and only if £ = £^ 

(v) £ is non- degenerate if and only if £ (1 £^ = {0} 
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Other than in euchdean geometry, S and S do not span /C, in general. But the following 
result shows that the dimensions add up as usual (a statement that is not very interesting in 
infinite dimension). 

Proposition 1 Let £ and he subspaces of IC. Then: 

(i) £ CJ^ ^ J^^ C£^ 

(ii) £^+J^^ = {£n and {£ + J^)^ = £^ n J^^ 

(iii) Ker( J|f ) =£n£^ 

(iv) dim(^) + dim(^^) = 2n 

(v) Lagrangian subspaces of IC have dimension n. 

Proof, (i) to (iii) are obvious, (iv) For the usual orthogonal complement £^ to £ (w.r.t. to the 
euclidean scalar product on IC), one has dim(£^) + dim(£^-'-) = 2n. It is hence sufficient to provide 
an isomorphism between £^ and £^. Indeed, one has J£^ = £^. (v) follows from £^ = £. □ 

Two closed subspaces are said to form a Fredholm pair if both their intersection and the 
codimension of their sum are finite dimensional. A frame for a subspace is a partial isometry 
from some Hilbert space onto it. More details on these Hilbert space concepts are recollected in 
Appendix [Bl 

Proposition 2 Let £ and T be a Fredholm pair of Lagrangian subspaces with trivial intersection 
and let $ and be frames for them respectively. Suppose that H = £ + . Then the oblique 
projection P with range £ and kernel T is given by 

P = $ (^*J$)"^^* J. 

Proof. This follows directly from Proposition WT\ because J\E' is a frame for J-"-*-. □ 

As already pointed out, £^ and £ do not span IC in general. If, however, £ is non-degenerate, 
then this holds as shown in the following result. 

Proposition 3 Let £ be a closed non- degenerate subspace of IC with frame $. Let us suppose 
that ^ a,,,{^*J^). Then 

IC = £ + £^ , (1) 
and the oblique projection P with range £ and kernel £-^ is given by 

p = $($*J$)"^$V . (2) 

It satsifies P* = JPJ. 

Proof. For ([1]) one has to show that every G /C can be written as (p = + ifj with unique 
vectors u and ifj E £~^. For that purpose, let us multiply this equation from the left by $* J. As 
^*Jip = 0, this gives $*J0 = $*J$w. Now the non- degeneracy of £ shows that is not an 
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eigenvalue of the self-adjoint operator $* J$. As there is no essential spectrum by hypothesis, it 
follows that $* J$ is invertible. Thus 

Then ^/^ = — $?; is by construction in As there was no freedom in this construction, 
uniqueness of v and ip is guarenteed. Furthermore, the projection P is given by Pcf) = $f leading 
to ([2]) . From this the last formula is now readily deduced. □ 

2.2 The inertia and signature of subspaces 

First let us recall that for any self-adjoint operators H = H* (identified with a quadratic form), 
the inertia ^{H) = (z/+, z/_, z/q) is defined by the dimensions of the spectral projection of H on 
(0,oo), (—00,0) and {0} respectively. The inertia is sometimes also called signature, but here 
the signature of H is Sig{H) = — Another number used in this context is the Witt index 
min{zy_|_, !/_} -|- Uq (this is equal to the dimension of the maximally isotropic subspaces). If Uq 
vanishes, it is often suppressed in the inertia. If H acts on an infinite dimensional Hilbert space, 
all entries of the inertia can be infinite, but, of course, one is most interested in cases where some 
of them are finite. The main result about the inertia used below is Sylvester's law stating that 
v{C*HC) = i^iH) for any invertible operator C. Furthermore, one has v{H~^) = ^{H) for any 
invertible H. 

Definition 3 Let £ he a subspace of a Krein space (/C, J). If ^ is a with frame for S, then let 
us set Jg = $*J$. The inertia ^{E) = (z^+(£^), z/_(£^), z/o(^)) and signature Sig(£^) of S are the 
inertia and signature of Jg, that is, ^{E) = ^iJe) and Sig(£^) = Sig(j£-). 

Sylvester's law of inertia implies that the definition of i^iS) and Sig(£^) is independent of the 
choice of the frame $. Let us note a few obvious connections between inertia and the other 
notions introduced above. 

Lemma 2 Let S be a subspace of }C. 

(i) £ isotropic i^+(^) = ^-i^) = 

(ii) S non- degenerate <^=^ i^oi^) = 

(iii) S positive definite <^==^ J^oi^) = ^-(^) = 

(iv) S negative definite <^==^ i^o{^) = i^+i^) = 

(v) u+{S) + u^S) + uoiS) = dim{£) 

The following result provides an alternative way to calculate the inertia and the signature of 
a non-degenerate subspace. 

Proposition 4 Let S be a closed non- degenerate subspace of IC with frame $. Let us suppose 
that ^ cress($*J$). Further let P be the oblique projection given by ([2]). Then is also 
non- degenerate and 

IC = S + S^ , v{E) + v{E^^) = (n,n,0) . 



6 



Furthermore 

iy+{£) = v+{P*JP) , V-{£) = u^{P*JP) . 
Proof. Let $ and be frames for S and S^. Then ($, ^) is invertible in IC and 

From this the first claims can be deduced. As to the last one, let us first of all note 

P*JP = J$($* J$)-^$* J . 

Therefore 

u{P*JP) = !/($($* J$)-^$*) . 
Because the kernel of $* has dimension 2n — dim(£), it now follows that 

v{P*JP) = i/(($*J$)-^) - (0,0,2n-dim(£:)) . 
Prom this the result follows. □ 

2.3 Lagrangian subspaces 

This section further analyzes the Grassmanian L(/C, J) of J-Lagrangian subspaces. It will be 
useful to describe Lagrangian subspaces by Lagrangian frames. Because Lagrangian subspaces 
are half-dimensional and closed, it is suggestive to choose these Lagrangian frames as linear 
maps )-/C = 'H©'H with $*$ = 1 and such that Ran(<l>) is a Lagrangian subspace. This 

latter fact is equivalent to $* J$ = 0. The set of Lagrangian frames is a U('H)-cover of L(/C, J) 
because $ and span the same subspace for every u e U('H). Moreover, is an orthogonal 
projection in K, with range given by the range of The complementary orthogonal projection 
J$( J$)* projects on the J-Lagrangian subspace with frame J$ and one has 

1 = + J$(J$)* . (3) 

Clearly, also the set of all orthogonal projections with range given by a J-Lagrangian subspace 
is in bijection with L(/C, J). 

Theorem 1 Let ^ he a fixed Lagrangian frame. For any other Lagrangian frame introduce 
hounded operators x and y onT-L hy 

^ ^ X + J'if y , (4) 

and define the stereographic projection of $ along ^ by 

7rvp($) = {x + y){x-y)-^ = {x + y){x-yy. (5) 

Then 7r,p is well-defined and unitary, namely 7r,j,($) G 0(7/). Moreover, one has 7r^{^) = 7r^{^u) 
for any u G U('H) so that 7r,i, factors to a map on L(/C, J) also denoted hy tt^. It establishes a 
hijection tt^ : L(/C, J) — )■ IJ{'H) with inverse given hy 

^^'(«) = + + (6) 

where the r.h.s. 's of this equation gives one representative in L(/C, J). 
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Proof. Equation (jl]) can be rewritten as 
Now one directly checks that (\E', J"^) is unitary. Thus 
is a frame, that is x*x + y*y = 1. Furthermore, one has 





so that 



(^, J^)*J(^, J$) 



X 

y 
1 . 



1 

1 



X y + y X , 



{x ±yy{x ±y) 

This shows that 7r,j, is well-defined and unitary. That the inverse is indeed given by ([6]) can be 
readily checked. □ 

Remarks A standard choice for a reference J-Lagrangian subspace is \& = 2~2 (^^). In this case, 
the stereographic projection is simply denoted by tt = 7r,i, and takes the following particularly 
simple form: 

7r($) = ab-' , $ = f (7) 



This also shows that tt^ is indeed a generalization of the standard stereographic projection in 
M^. If $ : "H — i- /C spans a Lagrangian subspace S, but only $c is a frame for some invertible 
c G ©("H), then one can still define x and ?/ by (jl]) and the first formula in (jS]) remains valid, namely 
7r(£^) = {x + y){x — y)"' . However, the factors x ±y are not unitary any more. Furthermore, vr 
allows to calculate tt^ via 



7rvp($) = (y2/3)V(^)*7r($)(y2/3) , ^ 



(8) 



As ^/2f3 is unitary, this shows that the spectra of and 7r(\l/)*7r($) coincide. Let us also 

note that for any u G U('H) 

7r^„($) = -u*7r*(<l>)M . 

In particular, the spectrum of '7r,j,($) does not depend on but only the Lagrangian subspace 
spanned by it. These spectral properties are of importance in view of the following result. o 

The dimension of the intersection of two Lagrangian subspaces can be conveniently read off 
from the spectral theory of the associated stereographic projection, as shows the next proposition. 

Proposition 5 Let £ and T he two J-Lagrangian subspaces of /C with Lagrangian frames $ and 
respectively. Then 



dim(£nJ^) = dim(Ker(^V$)) = dim(Ker(7rvi>($) - 1) ) = codim(£ + J^) . 
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Proof. Let us begin with the inequahty < of the first equahty. Let p G NU{oo} be the dimension 
of £ n J-". Then there are two partial isometries v, w : ^^({1, • . . ,p}) — ?■ "H such that = 
Then \l/*J$w; = \l/*J\l/t' = so that the kernel of \E'*J$ is at least of dimension p. Inversely, 
given an isometry w : ^^({1, • • • ,p}) "H such that \E'* J$iy = 0, one deduces that (J\E')*$i(; = 0. 
As the spans of \E' and J\E' are orthogonal and span all /C by ([3]), it follows that the span of "^w 
lies in the span of $. This shows the other inequality and hence proves the first equality. Next 
let us first note that the dimension of the kernel of \E'* J$ does not depend on the choice of the 
representative. Using the representative given in one finds 

= i(vr^($)-l) , (9) 

which implies the second equality. Finally the third equality follows from 

codim(£ + J^) = dim((£ + J^)^) = dim(^^ n (J^)^) = dim(j^ n JJ^) , 

and the fact that J is an isomorphism. □ 

Theorem 2 Let £ and T he two J -Lagrangian subspaces with associated Lagrangian frames $ 
and ^ . Then the following are equivalent: 

(i) £ and T form a Fredholm pair 

(ii) \E'* J$ is a Fredholm operator on 

(iii) 7r4,($) — 1 is a Fredholm operator on "H 

(iv) 1 is not in the essential spectrum o/7r,i,($) 

The index Ind(£^, J-") associated to the Fredholm pair of Lagrangian subspaces vanishes. 

Proof. The equivalence of (i) and (ii) follows from Theorem [TT] in Appendix [Bl The equivalence 
of (ii) and (iii) follows from the identity The equivalence of (iii) and (iv) holds for any 
unitary operator 7r,j,($), by the same argument showing that a selfadjoint operator is Fredholm 
if and only if is not in the essential spectrum. The last claim follows immediately from the 
definition of the index (see Appendix [B]) and Proposition [H □ 

The theorem shows that the spectrum of the unitary 7r,j,($) allows to determine a distance 
between the two subspaces. If its eigenvalues are phases close to 0, then one is near an intersection 
between the subspaces. The link of the angle spectrum a{£,J-') between the subspaces (see 
Appendix [B] for a definition) to the spectrum of 7r,j,(<l>) is discussed in the following result. 

Proposition 6 Let $ and \E' be Lagrangian frames. Then 

e"^ e fT(7r^($)) with ^ e (-TT, tt] ^ ^ ^ a{£, J^) . 
Proof. Using ([6]), one finds 

^*<l> = i(7rv,(<l>) + l) , 

so than 

= -(7r^($) + l)*(7r^($) + 1) . 



9 



Now by spectral calculus of the claim follows from j\e^'^ + Ip = cos^(^). □ 

Note that the spectrum of 7r,i,($) contains more information than the angle spectrum, namely 
a supplementary sign for each eigenvalue. In other words, a Lagrangian subspace J-" comes with a 
second Lagrangian frame JJ-" orthogonal to J-", and within the associated quarter plane splitting, 
one can define angles together with an orientation. 

2.4 The Bott-Maslov index in infinite dimensions 

Given a fixed Lagrangian subspace J-" in (/C, J) and associated frame for J-", let us introduce 
the Fredholm Lagrangian Grassmanian w.r.t. J-" by 

FL(/C, J, J^) = {S e L(/C, J) I {£,J^) form Fredholm pair } . 

One is now interested in (continuous) paths 7 = {'yt)tG[to,ti) IFL(/C, J, J-") and in counting the 
number of points t with non-trivial intersections 7^ fl J-", however, with an orientation as weight. 
This weighted sum of intersections is then the Bott-Maslov index which will now be defined in 
detail as a spectral flow. As in the finite dimensional case |Arn] . the singular cycle of Lagrangian 
subspaces with non-trivial intersections is the stratified space defined by 

= IJ §,(jr) ^ §^(jr) = {£ e FL(/C, J, | dim(^ n J^) = / } . 

i>i 

Note that for S G FL(/C, J,J^) it never happens that dim(£^ fl J-") = 00. Under the stereographic 
projection vr^r one gets from Theorem |2] 

7r.i,(§(j-)) = vun) , 

where Ucss('H) are those u G 0(7/) satisfying 1 cr^^^lu), and furthermore from Proposition [5] 

7rvp(§z(J^)) = {ue Uin) I 1 ^ and dim(ker(M - 1)) = / } . (10) 

Let now 7 — (7t)te[to,ti) a (continuous) path as above for which, for sake of simplicity, the 
number of intersections {t G [to,ti) \ 7^ G S(^)} is finite and does not contain the initial point 
to. Associated to 7 is the path 

ut = T^'iilt) e U,,,('H) , 

for which a spectral flow SF{{ut)te[to,ti)) through 1 is defined in an obvious manner, as recalled 
in Appendix [El This spectral flow now defines the Bott-Maslov intersection number or index of 
the path 7 w.r.t. the singular cycle S(J-'): 

BM(7,J-) = SF{iut)te[to,H)) . (11) 

Let us collect without detailed proof a few basic properties of the index. 

Proposition 7 ForT G U(/C, J) and 7 as above, set T7 = {T '^t)t(^[to,ti)- 

(i) Let the path J + 'j' denote the concatenation with a second path 'j' = {'Jt)te[ti,t2) FL(/C, J, J-"). 
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Then 

BM(7 + 7',J^) = BM(7,J^) + BM(7',J^) . 

(ii) Given a second path 7' = {'~it)[toM) ^^(/C', J' i^') where T' is a Lagmngian subspace in a 
Krein space (/C', J'), one has, with © denoting the symplectic direct sum, 

BM(7©7',J^© J-') = BM(7,J^) + BM(y,J^') . 

(iii) One has BM(T7,TJ^) = BM(7, J^). 

(iv) For a closed path 7, BM(7, J-") is independent of as long as it remains in FL(/C, J,J^). 

3 Basic analysis of J-unitary operators 

Let U(/C, J) denote the set of J-unitary operators, namely all T G B(/C) satisfying T*JT = J. 

3.1 Mobius action of J-unitaries 
Proposition 8 U(/C, J) is a *-invariant group. One has 



U(/C, J) 



a b 

c d 

a b 

c d 



a* a - c*c = 1 , d*d -b*b=l , a*b = c*d } (12) 
aa* — bb* = 1 , dd* — cc* = 1 , ac* = bd* 



and in this representation a and d are invertible and satisfy \\a ^\\ < 1, \\d ^\\ < 1. Also 
||a~^6|| < 1, ||(i"^c|| < 1, Wbd^'^W < 1 and ||ca~^|| < 1. 

Proof. The group property is obvious. Inverting T*JT = T shows T^^J(T*)^^ = J so that 
J = TJT*. The relations in ^ are equivalent to T*JT = T and TJT* = T. The fact that 
a is invertible follows from aa* > 1. Furthermore aa* — bb* = 1 implies that a~^b{a~^b)* = 
1 - a-^{a-^)* < 1, so that ||a-^6|| < 1. The same argument leads to the other inequalities. □ 

Theorem 3 The group U(/C, J) acts on the Siegel disc ©("H) = {u E ©("H) | ||w|| < 1} and also 
on U('H) by Mobius transformation denoted by a dot and defined by: 

^ -u = {au + b){cu + d)~\ ueMin). 

Proof. One first has to show that for u G MiTi) with \\u\\ < 1 and T G U(/C, J) the inverse in 
the Mobius transformation T ■ u is well-defined. By Proposition [HI {cu + d) = d{l + d'^cu) is 
indeed invertible. Then the identities of Proposition [8] imply 

{cu + d)* {cu + d) - {au + b)* {au + b) = 1 - u* u . (13) 
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Now multiplying (fT3|) from the left by {{cu + d)*) ^ and the right by (cu + d) ^ and using 
l-u*u>0 shows (T ■ M)*(r ■ m) < 1 so that T-ue ©("H). By the same argument, if w G U('H), 
then T ■ u & 0(7^). A short algebraic calculation also shows that {TT') ■ u = T ■ {T' ■ u). □ 

The action of U(/C, J) on I[J('H) is the stereographic projection of the natural geometric action 
of U(/C, J) on the Lagrangian Grassmannian L(/C, J). This natural action sends a subspace 

S G L(/C, J) to G L(/C, J). Let $ be a frame for S, then T$ is not a again a frame, but 

_i 

T ■ $ = T$((T$)*(T$)) ^ is a frame for T£^. Thus one indeed has using the above Mobius 
action: 

7r(T-<l>) = T-7r(<l>) . (14) 
The following calculation will turn out to be useful later on. 

Proposition 9 Let t Tt = ("*^|) be a differentiahle path in U(/C, J) and u G Then 
{Tt ■ uTdtiTt ■ n) = {{ctu + dt)-')* Q (t; JStTi) Q {ctu + dtT' . 

Proof. For sake of notational simplicity, let us suppress the index t. Using (T ■ u)* = {T ■ u)~^ 
and the laws of operator differentiation, one finds 

{T -uydtiT -u) = {Tfuy{d{au + b)){cu + d)-^ - {d{cu + d)){cu + d)-^ 

= {{cu + dy^y[{au + byd{au + b) - {cu + dyd{cu + d)] {cu + d)'^ . 

This directly leads to the identity. □ 



3.2 Basic spectral properties and Riesz projections of J-unitaries 

Most results in the section go at least back to |Lan] . and can also be found in |Bogj . Standard 
notations for the spectrum as well as the continuous, discrete, point and residual spectrum are 
used. 



Proposition 10 Let T be a J -unitary. 

(i) a{T) = 

(ii) a,{T) = ^JT)~' 

(iii) a,{T) = 

(iv) z G o'r{T) implies z^^ G crp{T) 

(v) z G o"p(r) implies z"^ G 0'p{T) U ar{T) 

(vi) a,(T) n§i = 

Proof. The main identity used in the proof is 

T-zl = r{{T*)-'^ - zl)J = zJ{T*)-\T-z-Hyj. 
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(i) As J and T* are invertible (with bounded inverses), invertibility of T — is equivalent to 
invertibility of T — (ii) Recall that the continuous spectrum consists of those points z for 

which T — zl is bijective and has dense range. Again these properties are conserved in the above 
identity, (iii) Due to (i) only remains to show that the isolated points z^'z~^ G cr(T) both have 
finite same multiplicity. But this follows from Proposition [TT] proved independently below, when 
combined with Proposition HD^v) . (iv) Let z G (7p{T) with eigenvector (f>. Then by (i) one has 
1^^ G <y{T) and wants to exclude 1^^ G crdT), namely that T — z^^l is bijective with dense 
range. Let us suppose the contrary. Then there exists a -0 G /C with 

^ (t)*J{T-^-^l)^ = (l)*{(T-^)* -z-H)Jil: = z-^ {{zl-T)(j))*{T-yjiJj. 

But this is a contradiction to T(f> = zcf). (v) Let z G (yr{T). Then there exists some Jif) G /C such 
that for all (;/) G /C 

= (J^)*(T- ^1)0 = z{{T -z-'^l)i)y{T*)-^J(t) . 

But this shows that T'ljj = z~^tp. (vi) is a corollary of (iv) and (v). □ 

Let T be a J-unitary and A C o"(T) be a separated spectral subset, namely a closed subset 
which has trivial intersection with the closure of cr{T) \ A. Then Pa denotes the Riesz projection 
of T on A and furthermore = Ran (Pa) and J-a = Ker(PA). If A = {A}, let us also simply 
write Px, S\ and J-^. The definition of Pa and a few basic properties which do not pend on 
the Krein space structure are recalled in Appendix O Next follows a list of properties of Riesz 
projections of J-unitaries. 

Proposition 11 Let T be a J-unitary and A a separated spectral subset. Then 

(Pa)* = J* Pf^yi J , -^A = J £(A)-'^ ■ 

Proof. First of all, let us note that indeed (A)~^ is in the spectrum of T by Proposition [101 and 
thus by the spectral mapping theorem one also knows that A is in the spectrum of T~^. Let us 
take the adjoint of the definition ( l53l) of the Riesz projection: 

(Pa)* = ^^(^-n"^ 

where F is the complex conjugate of F, hence encircling A instead of A. It is also positively 
oriented even though the complex conjugated of the path F would have inverse orientation, but 
the imaginary factor compensates this. Thus Pa(T)* = P^(T*) if one adds the initial operator 
as an argument to the Riesz projection. Next let us use T* = J*T^^J: 

Now Proposition 1^2^ 11) concludes the proof of the first identity. As to the second, 

J^i = Ker(PA)^ = Ran(P^) = Ran(JP(^)_i J) = J%)-i , 

so that the proof is complete. □ 
When combined with Proposition H^v) one obtains the following. 
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Corollary 1 Let A be disjoint separated spectral subsets of a J -unitary satisfying A fl A ""^ = 0. 
Then dim{£/\) = dim(£^-i). 

Proposition 12 Let A and A' be disjoint separated spectral subsets of a J -unitary satisfying 
A' n A^-*^ = 0. Then and £/^i are J -orthogonal. Similarly, J-'^ and J-"^, are J -orthogonal. 

Proof. By Propositions [H] and Hlj one lias 

P^JPa' = JP^-^Pa' = . 
But tliis is implies that Sa and £a' are J-orthogonal. The other claim is proved similarly. □ 

Proposition 13 Let T be a J-unitary and suppose that its spectrum is decomposed a{T) = 
IJ^j^ A; into disjoint separated spectral subsets A; satisfying Ai = {Ai)~^ . Then, with pairwise 
J-orthogonal subspaces, 

K = £a, + ... + £a^ . (15) 
Moreover, each summand is non- degenerate. 

Proof. The fact that /C = £ai + . . . + £al follows from Proposition H2r iv). Moreover, Propo- 
sition [12] implies that the subspaces are pairwise J-orthogonal. To prove the last claim, let us 
suppose that (p G £ai is in the kernel of Jls^^- Then (j) is J-orthogonal to £ai and hence by the 
above J-orthogonal to all /C. But as J is non-degenerate, this implies that = 0. □ 

3.3 Signatures of generalized eigenspaces of normal eigenvalues 

In this section, let us fix T G I[J(/C, J) which has K normal eigenvalue pairs of the unit circle and 
k normal eigenvalues on the unit circle. The eigenvalues off the circle come pairs and are denoted 
by {Xi, (A/)^^) with \Xi\ < 1 and I = 1, . . . ,K, and further let the eigenvalues on the circle be 
X'l, . . . , A'^. Let us denote the span of all associated generalized eigenspaces by £=, a notation 
which then coincides with the choice made for essentially S^-gapped operators in Section [5l Now 
Proposition [13] can be applied and it yields 

S= = £x[+... + £X', + (^A. + + . . . + (^A,, + £(^)-.) , (16) 

with pairwise J-orthogonal non-degenerate summands which all have trivial intersection. As to 
the dimensions, one has 

k K 

d\m{£J) = ^dim(^A;) + 2 '^dim{£x^) . 

1=1 1=1 

Let us set n= = dim(£^=). Let $= be a frame for £= and introduce the n= x n= matrices 
J^ = $^J$^ and T= = $1T$=. Then T= is J=-unitary. For sake of concreteness it can 
be useful to choose an adequate basis change corresponding to ([T6|l which brings J= into a 
particularly simple normal form. It is important to note that is in general not unitary. 
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Proposition 14 There exists an invertible n= x n= matrix N such that both N^'^T=N and 
N*J=N are block diagonal with blocks of the size of the summands in (fT6|) . Moreover, N can be 
chosen such that the first blocks of N*J=N corresponding to eigenvalues on the unit circle are 
diagonal with diagonal entries equal to 1 or —1 and that the blocks of N*J=N corresponding to 
eigenvalue pairs off the unit circle are J)- 

Proof. Let \I/ = [ipi, . . . , '0ri=) be composed by basis vectors of the summands in ( fT6l) . respecting 
tlie order of ([H]). Tlien define A^' by <I>=A^' = ^. Tlien clearly (A^')~^^=^' is block-diagonal, 
but because these summands are J-orthogonal, it follows that also {N')*J=N' is block-diagonal. 
Moreover, {N')*J=N' is self-adjoint and has no vanishing eigenvalue. In a second step, one can 
diagonalize the blocks corresponding to eigenvalues on the unit circle and then multiply with 
adequate invertible diagonal matrices in order to produce eigenvalues 1 and —1. Finally, by 
Proposition [T2] (applied to A = A' = {A;}), the blocks corresponding to eigenvalues off the unit 
circle are of the form 

\A* y ' 

where, moreover, A is invertible by Proposition [T3| as otherwise the block would be degenerate. 
Now the basis change 

\0 -lA-'J \A* o) \0 -iA~^) ~ \il y) 
can be done within this block. Combining these blockwise operations one obtains from A^'. □ 

Definition 4 Let X be a normal eigenvalue of T E U(/C, J) with generalized eigenspace £\. Its 
inertia (z/+(A), z^_(A)) is defined as follows: 

(i) // |A| = 1, then the inertia is the inertia of Sx, namely that of the form J^^ on Sx. 

(ii) //|A| > 1, then the inertia is equal to (dim(£^A), 0). 

(iii) //|A| < 1, then the inertia is equal to {0,dim{Sx)) ■ 

Eigenvalues for which z^+(A) = or z^-(A) = are called negative and positive definite respectively. 
An eigenvalue which is not definite is called indefinite or of mixed inertia. 

In the russian literature |Krel IGLl IYS| . the terms of first kind, of second kind and of mixed 
kind are used instead of positive definitive, negative definite and indefinite. Just as for quadratic 
forms, the inertia is also sometimes called signature and in the present context Krein signature. 
The inertia of the eigenvalues on the unit circle can be obtained by counting the entries 1 and —1 
of the corresponding block in Proposition [T3] and there is indeed no vanishing eigenvalue (which 
is where Uq^X) = is suppressed in the notation). For eigenvalues off the unit circle the definition 
of the inertia is rather a convention, which is, however, consistent with Proposition [H] because 
the inertia of blocks corresponding to Sx + Sj-i with |A| 7^ 1 is (dim(£^A), dim(£^A))- 

The following result shows that for eigenvalues on the unit circle the definiteness can be 
checked by only looking at eigenvectors (and hence not the generalized eigenvectors, often also 
called root vectors). 
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Proposition 15 Let X be a unit eigenvalue ofTE U(/C, J). Then 

z/-i-(A) = <^=^ =F (ffJct) > for all eigenvectors (p of X . 

Proof. The implication is clear. For the converse, let us show that the condition on the 

r.h.s. actually implies that Sx only consists of eigenvectors so that again the definiteness follows. 
Hence let us suppose that there is a non-trivial Jordan block, namely that there are vectors 
E S\ such that T0 = X(p and Ti/j = Xip + cj). Then 

0*J^ = (j)*T*JTi: = (A0)V(AV' + (^) = \X\^(l)*J'ilj + X(j)*J(f). 

Hence 

= (1 - \X\'^)(f)*Jilj = . 
But this shows (j)*J(f) = 0, which is a contradiction to the hypothesis. □ 

The previous proof actually also shows the following result. 
Corollary 2 Let X be a unit eigenvalue ofTE U(/C, J). 

(i) If there is a non-diagonal Jordan block for X, then X is indefinite and there exists an eigenvector 
(j) such that (f)*J(f) = 0. 

(ii) // A is definite, then all Jordan blocks are diagonal. 

The following is a conservation law of the inertia of all eigenvalues in S=. 
Proposition 16 The inertia ofT^ I[J(/C, J) as above satisfy 

J2 ^±(A) = i^±{S=) . (17) 

Proof. The inertia of the quadratic form J= is {i'^{S=),u_{S=)). By Sylvester's law it is 
also equal to the sum of the inertia of the summands it in the decomposition f|T6|) . Therefore 
Definition H] completes the proof. □ 

Proposition 17 The inertia z/(A) of normal eigenvalues of T E U(/C, J) depends continuously 
on the T. 

Proof. First of all, let us recall |Katt IV. 3. 5] that the normal eigenvalues of T depend continu- 
ously on T. Hence the result can be restated as follows. For any continuous path t G M i— )■ T{t) 
with T{0) = T, the eigenvalues X{t) can be labelled (at eigenvalue crossings) such that the inertia 
iy{X{t)) is constant in the sense that the sum of all inertia of colliding eigenvalues is constant. 
Clearly it is sufficient to prove this continuity at one point, say t = 0. As the eigenvalues of T 
off the unit circle stay off the unit circle for t sufficiently small, their inertia are preserved as 
well. Therefore one only has to consider eigenvalues of T on the unit circle. Hence let A be such 
an eigenvalue and P{t) be the finite dimensional Riesz projection of T{t) on all eigenvalues of 
T{t) converging to A as t — )■ 0. By |GKl Theorem 3.1], the dimension of Ran(P(t)) is constant 
in t. Let $(t) be a frame for P{t). Then the quadratic form $(0)*J$(t) has precisely i^+{X) 
positive eigenvalues and i^-{X) negative eigenvalues, and is not an eigenvalue because Sx is 
non-degenerate. By continuity of the eigenvalues of finite dimensional matrices, these proper- 
ties remain conserved for small t. But i^($(t)* J$(t)) is precisely the sum of the inertias of all 
eigenvalues converging to A as t —t- 0. □ 
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3.4 Krein stability analysis 



Proposition 18 Let X be a simple normal unit eigenvalue of T E U(/C, J). Then there is a 
neighborhood ofT such that the eigenvalue close to A stays on the unit circle. 

Proof. This follows from the symmetry of the spectrum of T stating that, if A is an eigenvalue, 
so is A . Thus if A would leave the unit circle, it would have to lead to two eigenvalues. □ 

Proposition [18] is of elementary nature. However, it does not allow to say anything about 
structural stability in presence of degenerate eigenvalues appearing. These issues were first 
addressed by Krein, and the following result is basically due to him |Krej and Gelfand and 
Lidskii [GL) . 

Theorem 4 Let A be an normal unit eigenvalue of T E U(/C, J). Suppose that A is definite. 
Then there is a neighborhood of T in which all operators have the property that all eigenvalues 
close to A lay on the unit circle and have diagonal Jordan blocks. 

First proof. Let us suppose the contrary. Then there exists a sequence of J-unitary operators 
(T„)„>i converging to T with corresponding eigenvalues (A„)„>i converging to A G such that 
for each n either (i) |A„| ^ 1 or (ii) |A„| = 1 with a non-diagonal Jordan block. Let 0„ G /C be 
corresponding normalized eigenvectors, namely T„(/)„ = \n4>ni such that (j)*^J(j)n = for all n > 1. 
Indeed, this holds in case (i) for all eigenvectors due to Proposition [12] (applied with two equal 
eigenvalues) and in case (ii) it can be assured due to Corollary [2]^i). By weak compactness of the 
set of unit vectors, there now exists a subsequence also denoted by that converges weakly to 
a vector 0. Then, for any ■0 G /C, 

rTcf) = lim i:*T(j)n = lim V^*(r-r„)0„ + ^*7:„(^„ = A V> • 

n—^oo n—^oo 

Thus T(j) = X(f) and similarly 0* J0 = so that A would not be definite. □ 

Second proof. Let t i— )• T{t) be the path of J-unitaries with r(0) = T. By Proposition [T71 the 
inertia has to stay definite for t sufficiently small. Hence it cannot leave the unit circle because 
this would lead to an indefinite inertia of the eigenvalue group by Proposition [H] □ 

Let us point out that both non-trivial Jordan blocks with eigenvalues on and diagonal 
Jordan blocks with mixed inertia are unstable in the sense that in any neighborhood of them are 
operators with eigenvalues off the unit circle. This can be shown by adapting the arguments in 
ffnite dimension from |YS] . 



3.5 The twisted graph of a J-unitary 

This section is an improved and generalized version of what is given in |SB2] . Let us associate 
to an operator Ton/C = 'H©'Ha new operator T = 1©T on = /C © /C where the © denotes 
the symplectic checker board sum given by 
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If T G U(/C, J), then T = 1©T is in the group U(/C, J) of operators conserving the form J = 
J® J- The stereographic projection from L(AC, J) to U(/C) defined as in ([7]) is denoted by tt. 
Furthermore, one can also define the symplectic sum of frames by 



a 
b' 



/ a \ 

a' 

b 

\0 b' J 



a,b,a',b' e Bin) . 



(19) 



If $ and \I' are J-Lagrangian, then $ © ^ is J-Lagrangian. Let us use a particular frame which 
is not of this form: 

/O 1\ 



^0 



V2 



1 
1 
\0 1) 

One has \E'q J \l/o = so that \I'o defines a J-Lagrangian subspace. Moreover, 



(20) 



7f(^^o) 



1 

1 



^0 



1 

7! 



^(^o) 

1 



f211 



Note that in our notations the hat always designates objects in the doubled Krein space /C, but, 
moreover, T is a particular operator in U(/C, J) associated to a given T e U(/C, J). Now as \E'o is 
J-Lagrangian, so is T^>q and one can therefore associate a unitary 7r(T\E'o) to it. This unitary 
will turn out to be particularly useful for the spectral analysis of T G U(/C, J) (see Theorem [6] 
below). 



Theorem 5 To a given T G U(/C, J) let us associate a unitary V{T) by 

V{T) = 7f($o)*7r(f $o) G U(/C) . 



(22) 



IfT={:'^,th 



en 



V{T) 



a — bd bd ^ 
-d-^c d-^ 



{a*)-^ bd-^ 
- d-^c d-^ 



Furthermore V{T) = 7r^f^^(T\E'o). The map T G U(/C, J) t-)- V{T) G U(/C) is a continuous dense 
embedding with image 



a (3 
7 6 



G U(/C) 



a, 5 G invertible 



(23) 



Proof. By (IT^ one has d*d > 1 so that d is invertible (similarly a is invertible). Now by 0141) . 

f ■7r(^o) ^ 



/ 1 \ 

a 6 

10 

\ c d / 



1 

1 
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so that writing out the Mobius transformation, one gets 



T-7r(^o) 



a b [ c d ~ [ a b [ d'^ [ - c 1 



From this the first formula for V{T) follows, and the second results from the relations in l][]C, J). 
Clearly its upper left and lower right entries, the matrices denoted by a and 6 in fl2S|) . are 
invertible. To check that V{T) is equal to 7fj^^(T\E'o) and not just unitarily equivalent as in 
can readily be checked. 

Finally let us show that the map T G U(/C, J) t— V{T) G U(/C) is surjective onto the set 
(123|) . Indeed, given an element of this set, it is natural to set d = 6^^, b = — c = 5^^7 and 
a = a — (36'^^. With some care one then checks that the equations in (fT2|) indeed hold. □ 

Proposition 19 Given T G U(/C, J), one has 

V{Ty^ = V{T)* = V{T-^) = JV{T*)J. 
Proof. Usine T^^ = JT*J, one finds 



, . _ , a 1 c*{d*) ^\ _ f a ^ a ^b 



and 

V(T~') - f""' -^"'^^ - ( -c*idT'\ .24) 

' ~ \ca-' {d*yy ~ [{d*)-'b* (d*)-' J ■ ^ ^ 

This shows the claim. □ 
The following result justifies the above construction and, in particular, the choice of \E'o- 

Theorem 6 Let T and V{T) be as in Theorem O Then 

geometric multiplicity of 1 as eigenvalue of T = multiplicity of 1 as eigenvalue of V{T) , 

and the eigenvectors coincide. 

Proof. One then has for all vectors v, v', w,w' 



as can readily be seen by writing everything out: 



a-bd'^c bd-^ \ fw\ _ fv'\ fa b\ fuj\ _ fv' 

-d-'c d-' J [w'J ~ \v) ^ \c d)\vj ~ \uj' 

In particular, studying an eigenvalue A of T one has 

f'") ^ t(")=x("], (25) 



Aw/ \ V J \v J \v 
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or similarly eigenvalues A of V: 

which means that T conserses the length of (^J) . Both equat ions are particularly interesting in 
the case A = 1: 

This equivalence proves the theorem. □ 

Remark An alternative proof of Theorem [6] is obtained by studying the Bott-Maslov intersection 
of r\l/o with \E'o. Suppose that these frames have a non-trivial intersection. This means that 
there are vectors v,w,v',w' G such that such ^E'o(^) = ^^o(^')- The first and third line of 
this vector equality imply w = w' and v = v', the other two that r(^) = (^). This shows 

geometric multiplicity of 1 as eig envalueofT = dim( T -'C H -'C) . 

But now Proposition E] can be applied to calculate the r.h.s., and this leads again to a proof of 
Theorem [6l o 

Remark If is an eigenvector of T G U(/C, J) with eigenvalue off the unit circle, then \\w\\ = 
\\v\\. Indeed, by fl25|) and the fact that V{T) is unitary and therefore isometric follows that 

II l|2 I I \ |2|| ||2 I \ |2|| ||2 I II ||2 

ll^ll + l-^l IpII = l-^l ll'^^ll + ll'^^ll • 

As |A| 7^ 1 the claim follows. This fact is compatible with the fact that the eigenspace Sx with A 
a normal eigenvalue off the unit circle is J-orthogonal to itself (see Proposition [T2l). However, in 
the above argument it is not required that A is normal. o 

Theorem [6] as well as the connection between eigenvectors can easily be adapted to study 
other eigenvalues on the unit circle. Indeed, if Tv = zv for z G S^, then also {zT)v = v. But the 
operator zT is also J-unitary so that one can apply the above again to construct an associated 
unitary. This shows the following. 



V{zT) = ni^oY^zT^o) = ( ^ ) ■ (28) 



Proposition 20 Let T = (^^) be a J-unitary and set, for z G 

d zd ^ 
Then 

geometric multiplicity of z as eigenvalue of T = multiplicity of 1 as eigenvalue of V{'zT) . 

Therefore, the unitaries y(zT) are a tool to study eigenvalues of T which lie on the unit 
circle. Let us focus again on 2; = 1. Theorem [6] concerns the kernel of V{T) — 1. It is natural 
to analyze how much more spectrum V{T) has close to 1, or, what is equivalent, how much 
spectrum the self-adjoint operator ^e{V{T)) = ^{V{T) + V{T)*) has close to 1. For this purpose 
let us calculate ^e{V{T)). 
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Proposition 21 Let T be a J -unitary and V{T) as above. Then 

sRe(y(r)) = (1 + T)(l + T*r)~\l + T)* - 1. (29) 
Proof. Let us begin by calculating 

^eiyiT)) = ]^{y{T) + v{Ty) = ]^{y{T) + i){y{T) + iy - i. 

Now V{T) = 7r($o)*7r(f $o)- The frame $o defined as in ([20]) satisfies $^$o = 1- On the other 
hand, T is not a frame, but 

$ = f §0 ((f §o)*T^o)'^ . 

is a frame with range equal to the range of T'^q. Furthermore, using the representation formula 
([6]) for Lagrangian frames by their unitaries as well as (12T]) . one shows that there is a unitary 
U e U(/C) such that 



1 fniT^o)\ /^^(^ 



1 



{v{Ty + 1) 



2 V 1 

Replacing this in the above shows that 

^e{V{T)) = 2%$$*^o - 1 = 2 $*f $0 ((r$o)*?^o)~^ (T$o)*$o - 1 
Hence remains to calculate the appearing products: 



(r^o)*r^c 



and 



(^o)*T^o 
Replacing shows the claim. 
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Proposition 22 let t^Tt= ("*^') 6e a dijferentiable path in U(/C, J). T/ien 
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Proof. First of all, 

V{TtrdtV{Tt) = 7f (7;§o)* 5t 7r(fi$o) = ■ 7r($o)* 5^ f, ■ 7r($o) 
Now one can apply Proposition [22] in the Krein space (/C, J): 

ViTtYdtViTt) = A*%f;jdtm^A, 

where the second identity in (12T1) was also used and A is given by 



A 



0\ , /I 



1 



Now the result follows from consecutively using the identities 

f;jdt ft = o®T;jdtTt , o © t $o = r , 

in the above. □ 

As a further preparation for applications below, let us calculate the derivative of V{zT) w.r.t. 
the phase z = e** G S""^ and thus set 

Q.(r) = -^V{e-''TydtV{e-''T). (30) 

This is a self-adjoint operator on /C and can hence also be interpreted as a quadratic form which 
by the following result is non-degenerate. 



Proposition 23 Let T = ("^) be a J -unitary. Th 



en 



Q{T) - I MV -1 -zb\f (a*)-^ 



d-^ J \ -zb* 1 M d-^ 

-{za-^bd-^y (dd*)-^ 



Moreover, a{Q^{T)). 

Proof. Deriving (p8l) and using for zT shows 



Qz{T) 



za-'^ -a-^b \ ( -l{a*)-^ 



{d*)-^b* z{d*)-^ J \ zd-^ 



from what the identity can readily be deduced. Furthermore, for the block operator in the middle 
of the expression for Q.^{T), a vector (^) in the kernel has to verify v + zbw = and zb*v — w = 0, 
so that {1 + bb*)v = and hence v = w = 0. Using Weyl sequences one checks that indeed there 
can be no spectrum at all close to 0, a property that is stable under conjugation with an invertible 
operator. □ 



22 



4 S^-Fredholm operators 



4.1 Definition and basic properties 

The definition and basic properties of Fredliolm operators are recalled in Appendix lAl 

Definition 5 Let T G U(/C, J) and z E E>^. Then T is called z-Fredholm if and only if T — zl 
is a Fredholm operator, and T is called -Fredholm if and only ifT — zl is a Fredholm operator 
for all z E 'B^ . The set of z-Fredholm and E>^ -Fredholm operators are denoted by F(/C, J, z) and 
F(/C, J) respectively. 

Let us collect a few first facts about such operators. 

Proposition 24 Let z E and T G F(/C, J, z). Then the following holds. 

(i) If S E U(/C, J) is such that S — T is compact, then S G F(/C, J, z). 

(ii) One has Ind(T - z 1) = 0. 

(iii) There exists an r > such that T — C 1 is Fredholm for all ( E C with |C ~ -2^1 < 

(iv) 5" G U(/C, J) is z-Fredholm if and only if S — zl is essentially bounded from below. 

(v) F(/C, J, z) is open in U(/C, J). 

Proof, (i) follows directly from the compact stability of the Fredholm property, (ii) From 
(T - ^1)* = zJT-^{T - zl)J follows that dim((T - zl)*) = dim(r - zl), which already 
implies the result, (iii) By Proposition [39l the hypothesis means that {T — z 1)*{T — z 1) is bound 
below by a positive constant except on a subspace of finite dimension. Now 

{T - zl){T - ziy = {TJ){T - zl)*{T - zl){TJ)\ (31) 

implies that also (T ~ zl)* is essentially bounded from below. Therefore again Proposition [39] 
concludes the proof, (iv) The identity 0311) for S instead of T implies that {S — z 1)* is essentially 
bounded from below if and only if 5"— ^ 1 is essentially bounded from below. Therefore Corollary H] 
concludes the proof, (v) This follows from the fact that the property of being essentially bounded 
from below, see (iv), is stable under small perturbations. □ 

Proposition 25 Let T G F(/C, J). Then the following holds. 

(i) If S E U(/C, J) is such that S — T is compact, then S G F(/C, J). 

(ii) One has Ind(T — zl) = for all z eS^ . 

(iii) There exists an h > such that T — C 1 is Fredholm for all z E C with < \z\ < e^. 

(iv) S E U(/C, J) is z-Fredholm if and only if S — zl is essentially bounded from below \f z eS^. 

(v) F(/C, J) is open in U(/C, J). 

(vi) T G F(/C, J) IS equivalent to T* E F(/C, J) as well as T'^ E F(/C, J). 

(vii) For T E F(/C, J), cr{T) fl S"*^ C o-p(T) and each eigenvalue has finite multiplicity. 
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Proof, (i)-(v) are obvious from the above, (vi) This follows immediately from the identities 
T* — zl = (T — zl)* and — zl = —T~^z{T — z) and the facts that the adjoint of a 
Fredholm operator is Fredholm, and the product of a Fredholm operator with an invertible 
operator is Fredholm. (vii) Combining item (ii) with Proposition SOI shows that there is neither 
continuous nor residual spectrum on S^. (That there is no residual spectrum on also follows 
from Proposition [TUT vi) . ) The second claim is part of the definition of T — 2; 1 being a Fredholm 
operator. □ 

Let us point out that the product ST of 5", T G F(/C, J) is in general not S^-Fredholm. Indeed, 
the product TT~^ = 1 is a counterexample. It is reasonable to expect that there is not too much 
spectrum on §^ for a §^-Fredholm operator. In fact, this is not true as shows the example in 
Section On the other hand, there is always little spectrum of V{zT) near 1 as shown in the 
following result. 

Theorem 7 Let T G U(/C, J). Then T is z-Fredholm if and only if 1 is not in the essential 
spectrum ofV{zT), or equivalently a^ss{^eV{zT)) < 1. Therefore, 

TgF(/C,J) ^ max (T,,,(gfte1/(^T)) < 1 . 

Proof. The fact that 1 is not in the essential spectrum of V{zT) is equivalent to V{zT) — 1 = 
7r(\E'o)*7r(^2^^o) ~ 1 being a Fredholm operator. By Theorem [2] this is in turn equivalent to 
the fact that the subspaces Ran(\E'o) and Ran(^r\E'o) form a Fredholm pair of subspaces in 
/C = H^^. Reordering the first three components 1, 2, 3 in H^'^ to 3, 1, 2, one obtains equivalence 
with Ran(Q)) and Ran((_'!j,)) being a Fredholm pair of subspaces in 'H'^^. As a frame of the 

orthogonal complement of Ran((]^)) is -^{\) and a frame for Ran((_"!^)) is + T*T)^^, 

Theorem [TT] shows equivalence with (l+T*T)^^(l—zT*) being a Fredholm operator on 7/®^ = /C. 
As multiplication by an invertible operator does not change the Fredholm property, one concludes 
that 1 ^ a^^^{V{zT)) is equivalent to T — zl being a Fredholm operator. □ 

The gap in the essential spectrum of V{T) is studied in more detail in Section 14. 3[ 

4.2 Intersection index for paths of ^-Fredholm operators 

Let F = {Tt)telto,ti] be a path in ¥{)C,J,z). Then V(zTt)t^it^^^t^] is a path in the set Uess(/C) of 
unitaries U G U(/C) with 1 ^ a^aaiU)- Under the same transversality conditions as in Section [231 
and Appendix [E] it is then possible to define an intersection index IN(r, z) by using the spectral 
flow of t G [to)^i] ^ V{zTt). In other words, 

m{T,z) = SF((y(^ri)ie[i„,i,]) = BM(2r§o,$o) , 

where ^F \E'o = {'zTt \E'o)ie[to,ti] is (after normalization) a path in the FL(/C, J, \I'o). The intersec- 
tion index IN(r, z) counts the number of solutions Tt(f)t = z(f)t along the path, but weighted by an 
orientation given by the inertia. If nothing is known about these inertia, the intersection index is 
really of little use. But in concrete situations such information may be available, for example by 
using Proposition 1221 Examples are the solutions of a Hamiltonian system (Section EH]), concrete 
paths (Sections 16. 2^ 1^31 and 16.8]) as well as the more structural result given in Section [531 
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4.3 The essential gap of V{T) 

The aim of the following results is to make the gap in the spectrum and essential spectrum of 
V{T) more quantitative and to provide tools to check whether a given J-unitary is S^-Fredholm. 
This section is not crucial for the understanding of the sequel. For an arbitrary operator A on 
some Hilbert space, let us set 

g{A) = min a {{1 + A* Ay^l- A)* {1- A) {1 + A* Ay ^) (32) 
= snp {g>0\g{l + A*A) <{A-ir{A-l)} , (33) 

and similarly for gcss{A) where in (133|) one asks the operator inequality to hold only on a subspace 
of finite codimension. This quantity satisfies 

11 /^x 1 

< 9iT) < 



1+ ||TP 111 -TP - ' - 111 -TP ' 

and is therefore closely connected to the notion of pseudospectrum (near 1) |Dav| . If A is normal, 
then by spectral calculus 

g{A) = min ^} ^\ , ^eBB(^) = min ''^ ^' 



zea{A) l+I^P ' ' zG<Tess(A) 1+|-2| 

li A = V is unitary, then 

g{V) = 1 - max a{^e{V)) = dist(l, a(3Re(y))) , g^^^{V) = dmt{l, aU^e{V))) . (34) 

This applies, in particular, to V{T) so that g(y{T)) provides a good way to measure the gap at 
1. Using this notation, one has for a J-unitary T that 

T is §^-Fredholm '^==^ min g^^^{y{zT)) > . 

Next let us show that g(y{T)) and g^ss{V(T)) can also be calculated more directly from T, namely 
g{T) and g^ssiT) as defined in (l32l) . 



Proposition 26 For any J-unitary T, 

g{V{T)) = g{T) , ^...(^(r)) = g^T) , 

and 

g{T) = g{T*) = g{T-^) , g^T) = g^T*) = gUT'') • 

Proof. One can focus on g because g^^^ is dealt with in the same way. Let us begin with an 
obvious reformulation of 



g{V{T)) = 1 - max a{^e{V{T))) . 
Using Proposition [2T] one now finds: 

g{V{T)) = 2 - max a((l + T) (l + T*T)"\l + T)*) 
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If one sets ^4 = (1 + r)(l + T*T) 2, then on the r.h.s. intervenes the spectrum a{AA*), which 
except for the point is equal to the spectrum a{A*A). Therefore 

g{V{T)) = 2 - max (t((1 + T*T)"^(1 + T)*(1 + T)(1 + T*T)~^) 
= min a{{l + T*T)~^l-T)*{l-T){l + T*Ty^) . 

Hence comparing again with the definition ( !32|) the first claim follows. For the others, let us 
conjugate the inequality in (133!) with J and then T: 

g{l + T*T) < (T-1)*(T-1) <^ g{l + T-\T-^y) < (T"^ - l)(T"i - 1)* 

^ g {l + TT*) < {T-l){T-iy. 

From this the last claims all follow. □ 

Corollary 3 For any J -unitary T G U(/C, J), one has 

TgF(/C, J) ^ inf gW^T) > . 

Due to the importance of the gaps g{T) and g^^^{T), let conclude this section with a stability 
analysis for them. Actually, such an analysis is even possible for g{A) and gessiA) and a general 
operator A on a Hilbert space, but for J-unitaries the estimates can be considerably improved. 

Proposition 27 Let T G F(/C, J) and K G B(/C) he a J -anti- self adjoint operator, namely satis- 
fying JK = —K* J . Then 

(i) If K is compact, then Te^ G F(/C, J) and g^ssiTe^) = g^ss(T). 

(ii) IfgiT) >6\\T\\ \\K\\, thenTe^ G F(/C, J) with g{Te^) > ^(T) - 6 ||T|| \\K\\. 

(iii) //^,,,(T) > 6||r|| \\K\\, then Te^ G F(/C, J) with g^^^Te^) > g^^^T) - Q\\T\\ \\K\\. 

Proof. The claim (i) follows immediately from general principles, but also from the argument 
below. Let us use the notations 

so that 

— ^\ faa + lry af3 + h6\ _ fa + aa + lry b -\- a(3 + b6 
dj yea + d'y c/S + d6 J + ca + (^7 d + c/S + d6 

Because Te^ G U(/C, J), it follows that the diagonal entries a' = a + aa -\- try and d' = d + cj3 + d5 
satisfy (a')*a' > 1 and {d'yd' > 1 and are therefore, in particular, invertible. It follows that 



V{Te 



(a-i)*((l + a + a-i67)-i) {b + aa + + d~^c(3 + 6)-^d-^ 



1^-1 



-(1 + d-^cl3 + 5y^d'\c + ca + d^) (1 + d-^c(3 + S)-^d 

( -{{a'y'yia + a-'b^y {aa - a - {a*y^ydr'\ 

^>^\{d')-\{cP + d5)d~^c-ca-d^) -{d-'c/3 + 6yd'y' ^ ' 
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where for the upper right entry in the second equation the identity bd = a — (a*) ^ was used. 
From this one can also readily write out a formula for ^e{V{Te^)) — ^e{V{T)). 

Now let us suppose that K is compact. Then also its entries a, /3, 7 and 6 are compact. Thus 
( !35|) implies immediately that V{Te^) — V{T) is compact. But now Weyl's theorem implies that 
the essential spectra are the same. 

Now let us bound y(re^)-y(r). Thus one needs to control the norms of the entries of (l35ll . 
Clearly the four entries of T and K are bounded by ||T|| and \\K\\ respectively. As — 1 

and — ^^"^ ^y Proposition [8] also ||a~"'^6|| < 1 and ||rf~"^c|| < 1, it follows that 

\\{{a')-^)*{a + a-H-f)*\\ < 2\\K\\ , \\{d')-\{c/3 + d6)d-^c - ca - d-f)\\ < 4 ||r|| , 

and similarly 

\\{aa-a-{a*)-^){d')-^\\ < 3 ||T|| ||K|| , \\{d-^cl3 + S){d')-^\\ < 2\\K\\ . 

As 1 < ||T||, the claimed bound (ii) now follows from Lemma [3] below which holds for arbitrary 
block operators and is stated without proof (see, e.g. |AI] ) . For (iii) one, moreover, needs to 
appeal to a standard argument with singular Weyl sequences. □ 

Lemma 3 For T G B(/C), one has 

T = > a>0, (i>0, c = 6*, ||a"^6d"^ || < 1 . 

5 Essentially S^-gapped J-unitaries 
5.1 Definition and basic properties 

Let us introduce the notation = G C | e^^ < < e'^} for a closed annulus of width /i > 0. 

Definition 6 A J -unitary T is said to he essentially -gapped if and only if a^^siT) fl §^ = 0, 
and strictly -gapped if a{T)r\S^ = 0. The set of all essentially -gapped J-unitaries is denoted 
by G(/C, J). Moreover, T is said to have an essential S^-gap h(T) > if the closed annulus E>\^rp^ 
contains no essential spectrum of T and there is no spectrum on the boundary of the annulus. 

Note that if n = dim('H) < 00, all J-unitaries are essentially §^-gapped. An alternative 
terminology would be to call essentially S^-gaped J-unitaries essentially hyperbolic, and strictly 
S^-gapped J-unitaries hyperbolic, but this will not be used here as we prefer to stick with the 
notion linked to spectral theory. 

Proposition 28 Any -gapped J -unitary is also E>^-Fredholm, that is G(/C, J) C F(/C, J). The 
set of -gapped J-unitaries G(/C, J) is open in the norm topology. 
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Proof. The first claim results from general principles {e.g. [EEJ), the second one follows directly 
from Theorem 1.3.1 of |GK] . □ 

A natural question about essentially S^-gapped J-unitaries is whether this property is sta- 
ble under compact perturbations, namely whether a Weyl type stability theorem holds as for 
selfadjoint and unitary operators. A positive result in this respect is the following. 

Proposition 29 Let T G G(/C, J) and suppose that there is a path in the resolvent set from to 
S^. Then, if S E U(/C, J) is such that S — T is a compact operator, then S e G(/C, J). 

Proof. As S is bounded, is always in its resolvent set. Therefore the claim follows immediately 
from analytic Fredholm theory as reviewed in Appendix [Dl □ 

Thus remains open the situation when there is no path in the resolvent set from to S^. Again 
by analytic Fredholm theory, see Appendix O, it is possible that the component of the resolvent 
set containing is filled with point spectrum after a compact perturbation. That precisely this 
can indeed happen is shown by example in Section 16.41 

5.2 The signature of essentially §^-gapped operators 

Recall that, given T G G(/C, J) and h > sufficiently small, S= denotes the finite dimensional 
subspace consisting of the span of generalized eigenspaces for eigenvalues of T lying in the annulus 
E>\. For this collection of eigenvalues and generalized eigenspace S=, all the notations and results 
of Section 13.31 apply. If h is chosen sufficiently small, one can assure that the spectrum of T 
in Sjj lies only on the unit circle (which does not necessarily mean that T\£^ is unitary because 
there may be non-diagonal Jordan blocks). However, this will not be assumed because we will 
be interested in paths of essentially S^-gapped J-unitary operators along which eigenvalues may 
leave or enter the unit circle, and also 

Definition 7 The signature Sig(r) of T E G(/C, J) is the signature of £=, namely 

Sig(r) = u^{s=) - u4s=) . 

By Proposition [161 the signature can also be expressed in terms of the inertia z^±(A) of the 
eigenvalues A G Sj^: 

Sig(r) = J] i.+(A) - Yl ■ 

\&ln<T{T) AeSincr(T) 

Theorem 8 The signature is well-defined {independent of the choice of h) and a homotopy in- 
variant on G(/C, J). 

Proof. Changing h in a continuous manner (such that there is only discrete spectrum of T in 
Sjj, of course) may lead to more or less eigenvalues of T in S\. However, these eigenvalues always 
come in pairs (A, A ) off the unit circle with dim(£^A) = dim(£^^-i) by Corollary [1] Moreover, by 
Propostion [131 the subspace Sx + Sj-i is non-degenerate and has inertia {dim{Sx),dim{Sx),0). 
Hence this subspace and hence this eigenvalue pair do not contribute to the the signature Sig(T) 
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anyway. Next let us consider a path Tt in G(/C, J). Again eigenvalues may leave the annulus 
§>\ (now of fixed size), but the above argument transposes directly to this case. Concerning 
bifurcations of eigenvalues on the unit circle it was already shown in Proposition [T7] that the 
inertia are constant (which is a local statement) and therefore also their contribution to the 
signature is constant. □ 



Proposition 30 If dim(n) < oo, then Sig(r) = for all T e G(/C, J) = F(/C, J) = U(/C, J). 

Proof. Because one can choose h such that it contains the whole (only discrete) spectrum of T, 
it follows that £= = JC and therefore Sig(T) = Sig(/C) = dim('H) - dim{n) =0. □ 

Actually, it is not an easy endeaver to produce examples with non-trivial signature. This is 
the main object of Section ESI Let us first provide an alternative way to calculate Sig(T). 

5.3 The spectral flow of essentially §^-gapped operators 

It follows from the explicit formula (128|) for y(e~**T) that the path 

Tt = (y(e-*T))ie[o,2.) , (36) 

in U(/C) is real analytic. Therefore all results of analytic perturbation theory [Kat| apply and 
assure that all discrete eigenvalues depend real analytically on t (if adequate branches are chosen 
at level crossings). Moreover, if T G F(/C, J), then 1 is not in the essential spectrum of V{e~^^T) 
for all t G [0,27r). Therefore it is possible to define an associated intersection index as in Sec- 
tion |1]2] provided that 1 is not a constant eigenvalue of r^. If 1 is a constant eigenvalue, then 
Proposition [20] implies that each point on is an eigenvalue of T. As already pointed out, this 
may happen as shows the example in Section 16.41 On the other hand, for essentially §^-gapped 
J-unitaries this cannot happen, namely one has the following: 

Proposition 31 Let T G F(/C, J). The path Tt defined in (l36l) is transversal in the sense that 
there is no constant eigenvalue equal to 1 if and only ifTE G(/C, J). 

Therefore SF(r7-) is well-defined for T G G(/C, J). Of course, the spectral fiow is just a 
particular case of the Bott-Maslov index and the intersection index defined in Sections 12.41 and 

Ml 

SF{Tt) = IN((e-**r)ie[o,2.),l) = BM((e-*r $o)te[o,2.), $o) • 

Therefore, it counts the number of eigenvalues of T on the unit circle, but weighted by an 
orientation. Let us first note that the homotopy invariance of the spectral fiow (in the sense of 
Section 12.41 immediately implies the following. 

Proposition 32 // s i— Tg is a continuous path in G(/C, J), then s i— )■ SF(rrJ is constant, 
namely SF(rT) is a homotopy invariant. 

Furthermore, let us provide an explicit proof of the fact that SF(r7-) is trivial in finite dimen- 
sions, even though this also follows from Proposition [30] combined with Theorem [H] below. 
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Proposition 33 If n = dim('H) < oo, then SF(Tt) = for all T e G(/C, J). 

Proof. The unitaries V{zT) G l]{2n) are traceclass. Therefore, the spectral flow by 1 can be 
calculated as the total winding number: 

SF(rr) = / —TT{V{e-''TydtV{e-''T)) . 
Jo 27r« 

Now by Proposition [20] one finds 

Tv(ne-w(e-r)) ^ >Tv((f;;;:; 7if:^){-'V'^ AO) 

= tTi {- {a* a)-^ + (dd*)-^) 

But as a* a = 1 + c*c and dd* = 1 + cc*, the unitary invariance of the trace implies that the last 
expression vanishes so that SF(rr) =0. □ 

In general, the operator V{e^'^^T)*dtV{e~'^^T) is not trace class so that the above calculation 
cannot be carried through. It may not come as a surprise that this orientation is given by the 
inertia of the eigenvalue. Actually, this follows from an explicit formula proved next. 

Proposition 34 Let T G F(/C, J) have a simple unit eigenvalue e*"^ with eigenvector (p. Let e*^* 
be a discrete non- degenerate eigenvalue of l/(e~**T) depending analytically on t and satisfying 
6q = if. Then 

Proof. By considering e~*'^T instead of T, one sees that it is sufficient to consider the case 
if = Q. Thus one has T(j) = (f) as well as JT*J(j) = (p and V{T)(p = 0. The phase speed can now 
be calculated using the quadratic from Qi{T) defined in (l30l) : 

dt9A= <P*Q,{T)<f) = -i<j)*dtV{e-''T)\ ' - 



Now one can proceed as follows: 



OJ \-b* d* J ^ ^ \-c d J \0 d 

where in the last equality the relation {a*)^^c* = bd^^ was used which is equivalent to the relation 
c*d = a*b, see Propostion [Si □ 

Based on the previous proposition, one can now prove that the spectral fiow and the signature 
are equal, up to a sign. 

Theorem 9 For all T G G(/C, J), one has Sig(T) = -SF(rT). 

Proof. Because both Sig(T) and SF(rr) are homotopy invariants by Theorem [8] and Proposi- 
tion [321 it is possible to deform T in such a manner that all eigenvalues on are simple. But 
for such T the orientation of the spectral fiow of the eigenvalues of l^(e~**r) through 1 is due 
to Proposition [3H given by the inertia of the corresponding eigenvalue of T multiplied by — 1. 
Summing over all inertia is thus equal to minus the spectral fiow. □ 
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5.4 Block diagonalization of J-unitaries 

Let us begin with the construction of a number of objects naturally associated to a S^-gapped 
J-unitary T with a given (and fixed) gap h{T). First of all, the spectrum can be split in three 
subsets: 

A> = G a(r) I \z\ > e'^^^)} , A< = e a(T) | 1^1 < e-'^^^)} , 

and A= = cr(A) \ (A+ U A_) C Of course, this splitting depends on the choice of 

h{T), but this will be irrelevant for our purposes below. Associated to the splitting are Riesz 
projections denoted by P> = Pa>5 P< = ^a< and P= = Pa=5 as well as T-invariant subspaces by 
= Ran(P>), = Ran(P<) and S= = Ran(P=) and r*-invariant subspaces = Ker(P>), 
= Ker(P<) and = Ker(P=). If necessary, also the notation £<,{T) = S^, etc., will be used. 
Let us also use P> = P> + P= and P< = P< + P= as well as S> and S<. Frames for S^, S=, 
£y and so on will be denoted by $<, $=, $>. Then $< = ($<, $=) is also a frame for £<^. Of 
course, for a strictly S^-gapped operator T, one has P= = and $= = 0. From general principles 
(see Appendix ICj) . 

1 = P< + P= + P> = P< + P> , = P<P> = P>P< = P<P= = P<P> , (37) 

as well as related identities. Every i; G in the range of the idempotent P< satisfies P<t' = v, 
and similarly for vectors in £>. This implies 

£< = J^> , J^< = £> , (38) 

as well as again related identities. Moreover, it follows from Proposition [TT] that 

P< = JP>J, PI = JP=J. (39) 

This implies 

= JT^ , = J J-^ , = J 8= . (40) 

Finally, Proposition [12] shows that _L S< and _L . In particular, and are isotropic 
(and Lagrangian for a strictly S^-gapped J-unitary). Thus 

<|.*^J$> = 0, $;.J<1>> = 0. (41) 

Another fact that will be of importance later on is that £= is non-degenerate by Proposition [131 
As a finite-dimensional space £= is also closed and therefore Proposition [H combined with JC = 
(£^< + Sy)+£= implies that 

i£=)^ = £^+£^. (42) 

Next it follows from Proposition [Hii) that {£=+£<)-^ = {£=)-^ fl {£<)-^, so that the equality fl42l) 
shows {£=+£<:)^ = (£^< + £y) n {£<:)^ = £<■ From this and a similar argument one deduces 

i£^)^ = £= + £^, i£y)^ = £= + £y. 

Finally let us note that there are also connections between the spectral subspaces of T and T*, 
denoted by £^{T), £^{T*), etc., for now. Indeed, 

£4T*) = Ran(P*) = Ker(P<)^ = T^T)^ = J £^{T) , £^{T*) = J £^{T) . 
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Proposition 35 Let T G G(/C, J). Then and form a Fredholm pair. 



Proof. As £^<, £y and £^ + £y are all ranges of Riesz projections, they are closed (see Proposi- 
tion |l2]in Appendix iBl) . Moreover, fl = {0} and dim((£^< + E^)-^) = dim(£^=) < oo so that 
all conditions of Definition [10] in Appendix [B] are satisfied. □ 

Associated to the Fredholm pair and is always a Fredholm index, which in the present 
situation is Ind(£^<, £^>) = — codim(£^<+£^>). This index is of little interest in the present situation 
though. For example, it does depend on the choice of the gap h{T) because this may modify 
the appearing codimension. The signature defined in Section 15.21 below is a more interesting 
and topological index. The main consequence of the Fredholm property relevant in the present 
context is the following. 

Proposition 36 Let T G G(/C, J). Then 
and 

P= = $= ($1 J$=)"^<I>1 J . 

Proof. The oblique projection P< has by definition range and kernel But = £> by 
(155]) and £> and £y only differ by a finite dimensional subspace, it follows that and form 
a Fredholm pair. Moreover, £^ fl J-'< = {0} and £^ + J-'< = /C by ( 1371) . Thus one can appeal to 
Proposition HI] to write out P<. Now $< is a frame for £^ by definition. Because J^^ = J£y 
by (jlO]) . a frame for J-"^ is given by J$>. Thus Proposition HT] allows to deduce the formula for 
P<. The one for P> follows in a similar manner. For the last formula, let us note that £= is 
non-degenerate by Proposition [TS] Therefore the matrix $^J$= is invertible. Hence the formula 
is well-defined and obviously an idempotent with range £=. As J-"^ = J£= by (I4UI) . the kernel of 
the r.h.s. is indeed J-'= as desired. □ 

Finally let us come to a block diagonalization of T G G(/C, J). For that purpose, let us set 

M = ($<,$=,$>) . (43) 

One can check explicitly using (l4T]) that 

/ <I>^J<I>< 

M*JM = <I>1J$= 
\<I>^J$> 

Thus the inverse of M is given by 

($;,/$<)-!' 

M-^ = I ($lJ<l>=)-i \ M* J 

' 

where the matrix is in the grading of (115]) . The invertibility of the three operators follows as in 
Proposition [23 Now the spaces £^, £= and £^ are invariant for T. Therefore the span of r$< 
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lies in and thus (HTj) implies $<JT$< = 0. Similarly $>JT$> = 0. Therefore one readily 
checks that 

/($*>J$<)-i$^ JT$< 

M-^TM = ($^J<l'=)-i<l>^ jr$= 

\ (<i>*<j$>)-i$^ jr$; 

But as r$< = $<$^T$< by the invariance property and because $<$^ is the orthogonal 
projection on S^, and similarly for T$> and T$=, it follows that 

/$*<T$< \ 

M-^TM = $^T$= . (44) 

\ ^IT^yJ 

The three entries are the restrictions of T to the invariant subspaces S^, S= and S^. Hence 
their spectra lie inside, on or respectively outside the unit disc. One can now further choose the 
frames such that the diagonal blocks become Jordan blocks, in particular, the finite dimensional 
matrix $!^T$=. It is also possible to use formula dHj) to construct S^-gapped J-unitary operators 
from a disjoint decomposition K, = + £= + into two isotropic subspaces and and a 
non-degenerate subspace S=. 



6 Examples 

The aim of this section is to illustrate the concepts and results of the paper by some examples. 
The formulas are often a bit easier if one works with another fundamental symmetry G obtained 
from J by the Cayley transform C: 

One then has G-Lagrangian subspaces, G-unitaries, F(/C,G), etc., and the passage from one to 
the other is just the Cayley transform. Note that G is the standard symplectic form, multiplied 
by a complex unit in order to make it self-adjoint and involutive. Symplectic matrices and 
transfer operators (see Section 16.61 below) are usually given in a form that is G-unitary rather 
than J-unitary, so that, pending on the scientific background, the reader may be more familiar 
with it. Another reason why to prefer one or the other representation in concrete situations is 
the following fact (which can be deduced from the examples in Section [^^ : J-unitary unitaries 
may be diagonal, but not G-unitaries; on the other hand, G-unitaries with spectrum off the unit 
circle can be diagonal, but not J-unitaries. Hence one can diagonalize unitaries within the group 
of J-unitaries, and hyperbolic operators within the group of G-unitaries. 

6.1 Positivity in linear Hamiltonian systems 

In this section, let us consider a Hamiltonian system of the form 

JdtTf = i{Ht + EPt)Tf , T(f G F(/C, J, 1) . (45) 



33 



Here i? G M is a spectral parameter, and Ht = and Pt > are Lipshitz continuous functions 
in B(/C). As one readily checks that dt[(Tf)*JTf^ = and as the initial condition Tf^ is J- 
unitary, it follows that the solution of ( H5|) is also J-unitary. Because the initial condition is, 
moreover, a 1-Fredholm operator and the set of these operators is open, the solution Tf" is also 
1-Fredholm, at least for sufficiently small t. For fixed (small) t, it is also possible to vary E in 
compact intervals such that still G F(/C, J, 1). Therefore there is a two-parameter family 
in F(/C, J, 1) associated to f H5|) and one can study the intersection index defined in Section I^l2] via 
the spectral flow of the unitaries VlTf). The transversality in t and E follows from the following 
positivity results, which are also crucial in the context of Sturm-Liouville type oscillation theory 
associated to the Hamiltonian system. In the finite-dimensional case, (i) and (ii) are due to 
Lidskii [LidJ, and (iii) to Bott [BotJ. Similar monotonicity results hold for the unitaries nq,(Tf^) 
whenever $ and \E' form a Fredholm pair of Lagrangian subspaces. 

Theorem 10 The solution of the Hamiltonian system fH5]) satisfies the following. 

(i) IfHt + EPt > 0, then i V{T,^ydtV{Tf) > 0. 

(ii) IfHt + EPt < 0, then i ViTfydtV{Tf) < 0. 

(iii) IfdETi^ = 0, then\V{TfrdEV{Tf) > 0. 

Proof. Recall that V{Tf) = 7r($o)* (^? ^o) = (§o)* ^? • ^(^o) so that 
-ViTfyd.ViTf) = i (ff ■7r($o))*9,(2f ■7r($o))* 

= - A*^*JO® {TfyjdtTf)^oA 

= A* {TfyjdtTf A , 

where in the second equality Proposition [9] was used and A is some invertible operator. Now 
using (H5|) . 

- V{TfydtV{Tf ) = 2A* {Tfy{Ht + EPt) Tf A , 
which implies (i) and (ii). Similarly, 

-ViTfydEViTf) = - A*(TfyjdETfA. 

Again from (H5l) one finds for e > 

ds {{TfyjTf+') = ie{Tfy P,Tf+' . 
As {TfyjTf = J= {T^yjT^, one thus has 

^ (TfyjdETf = lim(^6)-i {{TfyjTf-^^ - (TfyjTf) 

= Jim {^er' {{Tfy JTf^^ - {T^y JT^^^ + {T^y JT^^^ - {T^y JT^) 



f ds {T^^y p,t!^ + {T^yjdET^ 

Jo 
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Because Ps is non-negative and the last summand vanishes by hypothesis, this imphes (iii). □ 

6.2 The calculation of bound states by a Bott-Maslov index 

Let H = Hq + K he Si self-adjoint bounded operator on Ti given as a sum of a self-adjoint operator 
Ho called the free Hamiltonian and a compact operator K called the perturbation. In typical 
applications, Hq has a band spectrum which is purely absolutely continuous. However, all that 
is needed for the below is an interval A C M, possibly unbounded, in the resolvent set p{Hq) 
of Hq. It follows from Weyl's stability theorem for essential spectra that H has only discrete 
spectrum in A. The new eigenvalues and eigenvectors of H are called bound states. The aim of 
this section is to reformulate the calculation of these bound states as an intersection problem for 
a path of Lagrangian Fredholm pairs. With some more technical effort, one can also deal with 
unbounded-selfadjoint operators. 

For that purpose, let us use the frames 
as well as \E' = (J). These three frames are G-Lagrangian on /C. 

Proposition 37 Let E E A G p{Hq) fl M. Then the Lagrangian subspaces associated to $^ 
and ^ form a Fredholm pair and their intersection is empty for E G A. Furthermore, also the 
Lagrangian subspaces associated to and \E' form a Fredholm pair and the dimension of the 
intersection is equal to the multiplicity of E as bound state of H. 

Proof. In order to check the Fredholm pair property, let us use the characterization of Theo- 
remEKii), forumated for G instead of J. As ^*G<l>f = {E l-Ho){l + {Ho-E if)-'^ is self-adjoint, 
it is Fredholm if and only if is not in its essential spectrum. But this is given because E is not 
even in the spectrum. Next let us suppose that and \E' have a non-trivial intersection, namely 
that there are non-vanishing vectors v,w eH, such that = \E'w. Then the upper equation of 
this identity implies (1 + {Hq — E l)'^)~2v = w and the lower one {Hq — E l)w = 0. This would 
mean that E is an eigenvalue of Hq, in contradiction to the hypothesis. For the pair <l>^ and \I' 
one proceeds in the same way. Alternatively, one can use the fact that is obtained from $^ 
by compact perturbation. □ 

Due to this proposition, one can calculate the eigenvalues of i/ in A (namely the bound 
states) via the spectral flow of the unitaries 

EeA^V^ = ^(C^)*7r(C7$^) e l]{n) . 

By Theorem [21 this path is actually in Ucss('H). Of course, 7r(C\I') = 1 and by the explicit 
expression of 

= {l-i{H-El)){l + i{H-El))~^ = (G^ + ^l)(G'^-^l)-^ (46) 

where = {El — H)~^ is the resolvent whenever it exists. Precisely at the bound states this 
inverse does not exist, but nevertheless is well-defined by the first formula. 
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Proposition 38 Let A C p{Ho). Then E E A i-^ is a real analytic path in Uess('H) satisfying 

- (V^'y OeV^ > , lim = - 1 . 

I |£|-)-oo 

In particular, all eigenvalues of rotate in the positive sense as a function of E and cross 1 
transversally in the positive orientation. These latter eigenvalue crossings correspond exactly at 
the eigenvalues of H , with equal multiplicities. 

Proof. It only remains to verify the positivity of 

-{V^YdEV'' = -{V^)*\i{l + i{H-El)Y^ -V''{-i){l + i{H-El)y^' 

= 2 (^{1 + i{H - E l)yy {1 + i{H - E 1))'^ 

= 2{1 + {H-Elf)~\ 
which is obvious. □ 



6.3 The unitary V{T) for 2 x 2 matrices 

This elementary section provides the normal forms of 2 x 2 J-unitaries T, their G-unitary Cayley 
transform C*TC, and the associated unitaries y(e~**T) 

Example 1 Let us consider, for Lp,rj G M, 



One then finds 



This matrix satisfies 



cosh(?7) sinh(?7)\ c*TC ^ f^'' 
sinh(?7) cosh(77) J y i 



Tr(y(e-**r)) = ^ , , det(y(e-'*r)) = 1 . 

cosh(77) 





6"'^+*^ 



Hence the eigenvalues of y(e **T) are 



g^e±.t ^ cos((/; - t) ^ /-^ _ cos2(v? - t) 

cosh(?7) y cosh^(?7) 

In particular, 

max 3fJe(e*^±'* 



te[o,27r] cosh (77) 

which is thus strictly less than 1. Hence there is a gap to the value 1 on the circle. o 
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Example 2 Now let us consider 

rp ^ ( e"*'' \ ^^^^ ^ / cos(?7) - sm{r]) 

y e^^J ' Ysin(?7) cos(?7) 

Then 

Hence the spectrum can immediately be read off. 
Example 3 Let us consider the Jordan block 

\ -la l + ia) ' ^ ^ ~ ^ \Q 1 
where a e R. Then one finds 

' e<^-^) la 



V{e-'*T) 

This matrix satisfies 



-1*7-"^ _ I l+ia Ifta 
in. p-<v-t) 



1+ia 1+ia 



T.{V{e--T)) = , det(l^(e-r)) = . 

Hence the eigenvalues are 

e*^±'* = |^cos(^ -i) ± I ^a2 + sin2((^-t)^ . 

In particular, for t = (/? and say a > 0, one has e*^+'*' = 1 and 3fte(e*^"'*') = 1 — a^. Hence there is 
a gap to the value 1 on the circle. Furthermore, 

that is, the eigenvalue is touching 1 only from above. Therefore, there is no spectral fiow of 
t ^ y(e-'*T) through 1. o 

Example 4 Finally, let us study the family 

E _ (E — i E \ r^*rrE^ C^E —1 



^ - I £ E + ^ • ^•^"^= V 1 



Then 



Thus 



V{e'''T) = 



TV(y(e--T)) = , det(y(e--T)) = |^ 
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so that 



Let us now focus on i? > 0. Then 



E cos(t) + + sin^(t) 
1 + ^2 



If i? < 1, then cos(t) = E has two solutions > and t_ < for which then 6*+ = 0. For 
E = 1 there is one solution t = 0, while for i? > 1 there is no solution and hence 3fJe(e*^+'*) < 1 
uniformly in t. This is a bifurcation, but the spectral flow remains invariant. 

6.4 A finite rank perturbation of an §^-gapped G- unitary 

As motivation to this section, let us recall some results about the operator family St = S + tQ 
on f{Z) where S is the shift and Q = |0)(1|. For t = it is the shift, but Si = S = S+ ® S_ 
is the sum of a uni-lateral shift and its adjoint, where the direct sum decomposition is = 
e{Z+)®e^{Z_) with Z+ = N = {1,2,...} and Z_ = Z\Z+ = {0,-1,-2,...}, and 5± = S\i2(^z±)- 
Thus the spectrum of 5*1 is the unit disc filled with point spectrum because Yln>i^^ l'^) 
eigenvector with eigenvalue A G C as long as |A| < 1. As 5*1 is a finite rank perturbation of S, 
this provides an example for the scenario (ii) in the analytic Fredholm theorem of Appendix [Dl 
Note that the Fredholm index is Ind(S'i) = 1 — 1 = 0. On the other hand, the spectrum of St for 
t G [0, 1) is only the unit circle (see e.g. |Hah Problem 102], or argue as below). On the other 
hand, the family St is norm-continuous in t. This example shows that the spectrum as a set is 
only upper semi-continuous, namely limsupj_^^ c(5't) C (j{Si), but this inclusion may be strict. 

The aim of this section is to construct an example of Tt showing that the same phenomena 
may happen within the class of G-unitary operators (it is impossible in the class of normal 
operators). Let still S be the two-sided shift on i'^{Z) and r G (0, 1). Then one starts from 



acting on the Hilbert space i'^{Z) C^. The operator Tq is G-unitary and its spectrum is 



so that Tq is clearly S^-gapped. Now let P+ = |1)(1| and P_ = |0)(0| be the one-dimensional 
projections in £2(z) onto the subspaces spanned by |1) and |0) respectively and then set 




U r"^§- 




One has GK = —K*G so that K is in the Lie algebra of the G-unitaries and thus 




sin(t)P+ 
°+ + cos(t)P 
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is G- unitary and a compact perturbation of 1. Let us set 

Tt = Toe*^ = 



rS{l -P+) + r cos{t)SP+ r sm{t)SP+ 

-r-i sm{t)SP+ r-^S{l - P+) + r'^ cos(t)5P+ 



Claim a{Tt) = a{To) for t ^ f , ^, and 



l7{T3n 



{A G C|r < |A| < r-'} . 



(47) 



(4J 



Furthermore, in agreement with analytic Fredholm theory one has a^is{T^) = \ a"(To). 

This shows that the essentially §^-gapped operators are not stable under compact perturba- 
tions. Let us begin the proof of the claim by rewriting (H7|) . First recall that 

SIS+ = 1-P+ , S+Sl = 1 , S-S*_ = 1-P- , S*_S- = 1 . 

Furthermore, with the partial isometry Q = |0)(1| as above, 

Q*Q = P+, QQ* = P., Q = SP+ = P^Q . 

For the matrix entries of Tt one finds in the grading of £^(Z+) © £^(Z_) 



SP, 



Therefore acting on £^(Z^ 



Tt 




Q 



^(1 - Ph_ 



S+ 
5_ 



( rS^ 

rcos(t)(5 tS^ 



\-r-^^m.{t)Q 



5 £^(Z_) becomes 

\ 

rsin(t)Q 

r-^S^ 

r^-*^ cos(t)(5 r~^S-j 



Apart from t = 0, the points t = f , ^ are particularly simple because the 4x4 matrix operator 



decouples in two 2x2 matrix operators. Let us start with 



Hence it is sufficient to carry out the spectral analysis of the following block operators on £^(Z_|_) ( 
















\ 









rQ 






















v- 












I 



A, 



rS^ 



A. 



'r-^S+ 
r Q rS- 

Indeed, then cj(Ti) = (j{A^) U a{A_). Note that neither A^ nor A_ are G-unitary (for any G). 
As S± are unilaterl shifts, a singular Weyl sequence argument shows that rS^ fl r~^§^ C a{A±). 
Let us focus on A_ and look at the trial state 



(49) 



n>l 



n<0 
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where |A±| < 1 and a,j3 G C. Clearly ip G © As Q is a perturbation acting 

non-trivially only on the subspace spanned by |1), any eigenfunction of A- has to be of this 
form. Furthermore 

n>l n<-l 

Now for a given A G C with |A| G {r,r~^) let us choose X±, a and /3 such that 

. K r rA+ 2 

A = — = — , a = 1 , (J = — — = r . 
r A- A 

Then A^ij: = Xi/j. Thus the annulus {A G C | r < |A| < r~^} is in the point spectrum of A_ so 
that cr(yl_) contains the closure of the annulus. Outside of the annulus one could have point 
spectrum (this is the only spectrum allowed by analytic Fredholm theory because A^ is bounded 
and invertible), but actually the above argument shows that there are no further eigenvalues 
outside of the annulus. 

One can attempt to apply a similar argument to A^: 

A+i) = arX+J2K\^) ® Cii-r'^)K\0) + P {rX^Y^ J] A^'|n) . 

n>l n<— 1 

But now rA+ = (rA_)~^ is incompatible with |A-|-| < 1 and r < 1. Hence has no eigenvalue 
and (t{AY) = U r^^S^. Combining the above one thus concludes that (HHj) holds for t = f . 
The case t = ^ is dealt with similarly. 

Next let us do the spectral analysis of for t 7^ ^, By analytic Fredholm theory as 
described in Appendix [D] either cr(Tf ) \ a{To) only contains discrete spectrum, or all points in 
this set are eigenvalues. Thus let us look for eigenvalues of Tt. The eigenvectors have to be of 
the form 

n>l n<0 n>l n<0 

where all A's are of modulus less than 1 and the coefficients a and [3 are complex numbers, 
and the states |n, f) and \n,D correspond to the first and second component of £^(Z) © £^(Z). 
Applying Tt now gives 

T,^ = atrA,,,E^",tl->t) + |^E^-:'tl-'t) + ^E^"^^ 

n>l '"^ n<0 n>l '-^ n<0 

+ r(atcos(t)A+,-f- + a4sin(t)A+,4)|0, t) + ^(a^ cos(t)A+,4 - sin(t)A+,-f-) |0, |) . 

From this equation one deduces with some care that there cannot be any eigenvectors in the 
annulus {A G C|r < |A| < r"^} unless t = This completes the proof of the claim. 

Next let us calculate the unitaries V{zTt) as given in ( l28l) . For that purpose, one first has to 
calculate the Cayley transform of T. With r = e^, 

_ fcosh{h)S smh{h)S\ _ fl-P+ + e''P+ 

^ °^ ~ Vsinh(/i)5 cosh{h)Sj ' L.e u - ^ l-P^ + e-^'P^ 
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From this the J-unitary CTtC* can readily be written out. For (128|) . one needs the inverse of the 
adjoint of the upper left as well as the lower right corner of CTtC*, namely 



(cosh(/i)(l-P+ + e-**P+)^*) ^ = sech{h)S{l- P+ + e''P+) , 

(cosh{h)S{l -P+ + e-''P+))~^ = sech(/i)(l - P+ + e''P+)S* . 

..(-rp^ _ fzsech{h)S{l-P+ + e'^P+) tanh(^) \ 

~ V tanh(/i)(F+ -e2**P+ - 1) z sech(/i)(l - P+ + e**P+)57 

In particular, 



and 
Thus 



V{zTo 



zsech.{h)S tanh(/i) 
— tanh(/i) zsech.{h)S'* 



After Fourier transform the spectral analysis of the 2x2 matrix (see Example 1 above) applies 
and this shows that 3f?e(V"(2 Tq)) < sech(/i)~^l for all z G S^. Now V{zTil) is a finite range 
perturbation of Vi^To). Thus the essential spectrum is unchanged by Weyl's theorem. Moreover, 
as every ^ G is an eigenvalue of T by the above, it follows that 1 is always an eigenvalue of 
V{zT:l). Note that this is not a contradiction to the the fact ^ a{Qz{T)), because the quadratic 
form a{Qz{T)) has as many negative as positive eigenvalues. 



6.5 A loop in F(/C, G) with non-trivial intersection index 

This section completes the analysis of the example in the last section by calculating the intersec- 
tion number of the loop F = (Pt)tG[o,27r) where is given by (H7|) . As a finite rank perturbation 
of a S^-gapped G-unitary To, this is clearly a path in F(/C, G). Moreover, the analysis of the 
proceeding section shows that there are two intersection along the loop, namely at t = 
and both are of multiplicity 1. Hence IN(F) could be —2, or 2 and it remains to analyze the 
orientation at the two intersections. For that purpose, let us first note that 

-TTGdtTt = - TTGTtK = -GK = (^^ I > . 
z * « * t \0 P+J - 

It follows from Proposition |22l for the fundamental symmetry G instead of J, and the fact that 
the eigenfunction ( H9l) does not vanish on the range of P+ that the phase speed is positive. 
Therefore IN(r) = 2. 



6.6 Transfer operators 

This section merely presents a class of G-unitaries typically associated to discrete Schrodinger 
operators. More specific cases are studied in the following sections. Let H = H* G 18(7/) and 
A G B(H) such that G B(H) exists. Then 

r = (4-1 ' 
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is G-unitary on /C = "H Cg) "H. Let us look for an eigenvalue A G and eigenvector of T: 

\w J \w J y A V J \w 

The second equation enforces v = XAw. Replacing this into the first one, the eigenvalue equation 
is equivalent to searching for w G "H with 

{2 H - XA - {XA)*)w = 0, (51) 

namely for w G "H in the kernel of the self-adjoint operator H{X) = 2 H — XA — (XA)*. If such a 
w and A are given, then 

and, if the eigenvalue A is simple, its signature is the sign of 



XAw\ 
w J 



^(^^^^^ = -2Qm{Xw*Aw) 



For the rest of the spectrum one deduce from a Weyl sequence argument 

G (J{H{X)) ^ AG a{T) . 

In concrete situations, this also allows to examine whether T is S^-gapped. Furthermore, one 
checks 

(jrp(j* _ I f{2H -il-iA*A)A-^ {2H -il + iA*A)A-^^ 



2\{2H + tl-i A*A)A-'^ {2H + tl + t A*A)A-'^ 

This, and consequently the formulas for V{zT) and Qz{T) considerably simplify if A is unitary. 
Thus let us assume this from now on so that 

_ ({H-il)A-^ HA-' 
~ V HA-' {H + tl)A-' 

Due to the general formulas, 

VizT) = 

and 



z{H + il)-^A* H{H + il)-^ 
-aIh + il)-^HA* zA{H + il)-^'' 



-A{H^ + -zAHiH"^ + 

-z{H^ + ly^HA* {H^ + 



The speed of the eigenvalue of V{XT) crossing 1 is due to Proposition |34] equal to 



1 (XAwV fXAwX _ 2 (Aw* Aw) 
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6.7 § -gapped G-unitaries with discrete spectrum on the unit circle 

For a first concrete example of a transfer operator of the form (150|) . let A = 1 and H = H* G B('H) 
be such that a^^^{H) fl [—1, 1] = and suppose that Hw = fiw for some jj, G (—1, 1) and a unit 
vector w G "H. For sake of simplicity, let us also suppose that there is only one such eigenvalue. 
Then A is an eigenvalue of T if 2// = A + A^^. Actually then both A and A^^ are eigenvalues of T: 




As, moreover, ^ G (—1, 1), it follows that A G S^. Furthermore, a Weyl sequence argument shows 
that T is essentially S^-gapped. Let us examine the signature of A = e*''': 




= —2 sin((/?) . 



Thus the signature is negative for A in the upper arc of S^, and positive for A in the lower one. 
As the signature is the sum over all eigenvalue pairs on the unit circle, one has Sig(T) = 0. 

A concrete example is 2H = E - S - S* - cot(a)|0)(0| on U = with E ^ [-1,1] and 

S is the unilateral shift (which was also denoted by 5"+ in Section [6^ . This models a half-sided 
discrete Laplacian with adequate boundary condition a G [0,7r]. 



6.8 Essentially S -gapped G-unitaries with non-vanishing signature 

This example is inspired by the two-dimensional Harper model describing a tight-binding electron 
on a square lattice submitted to a magnetic field (in the Landau gauge). This connection will 
be made more explicit elsewhere. Let again T-L = P{N) and 2H = E — S ~ S* where S is the 
unilateral shift. Furthermore, the unitary is ^4 = e*^"^ where X is the position operator on £^(N) 
defined by X\n) = n \n) and finally 9 G [0,27r) is a phase (the magnetic flux through the unit 
cell). The G-unitary transfer operator T depending on the two parameters i? G M and 9 is then 
explicitly given by 

T - f{E-S-S*)e-'''' -e- 

Let us look for eigenvalues A = e*"^ of T by analyzing (151 p . which becomes more explicitly 

{E-S-S* -2 cos{9X + ip))w = . 

This is the Schrodinger equation he^^w = Ew for the one- dimensional (critical) Harper operator 
he,ip = S+S* + 2 cos{9X + (f>) restrict to the discrete half-line, that is, acting on ii'^(N). One is thus 
interested in its bound states (boundary states). For that purpose let us first of all choose and 
then fix i? G M in a spectral gap of the two-sided Harper operator hg^^ = S* -|- 5** -f- 2 cos(^X -|- 99) 
acting on i'^(Z), defined with the two-sided shift S. Second of all, let us suppose that the phase is 
rational 9 = 2n^. This is actually not a restriction because one can approximate irrational 9 by 
rational ones and use that T depends continuously on 9 so that the signature does not change. 
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The rationality assumption implies that the potential of hg^^p is p-periodic. As the half-sided 
Harper operator /ig is a Jacobi matrix, its bound states can be calculated by transfer matrix 
methods, as discussed in detail in jASV] . The transfer matrix over one period is the following 
real 2x2 G-unitary matrix of unit determinant: 

f E - 2 cos{en + ^) -l\ 

As E is not in the spectrum of h0^^p, the eigenvalues kT^ of 7^^ are off the unit circle. This 

also assures that T is essentially S^-gapped. One now has a bound state for /ig <^ if and only if 
the Dirichlet boundary condition coincides with the contracting direction, namely 




where \k\ < 1. For fixed E, this is a trigonometric equation for Lp. The (weighted) number of 
its solutions is actually equal to the Chern number of the Fermi projection of two-dimensional 
Harper operator on energies below E |ASVj . This number of solutions can thus take any integer 
value (when one is free to vary | as well as E, the only free parameters). For each solution yj, 
one then knows that e**^ is an eigenvalue of T. This shows that there are essentially S^-gapped 
G-unitaries that have non-vanishing signature. 



7? = n 



A Reminders on Fredholm operators 

A bounded operator T G B('H) on a Hilbert space is called a Fredholm operator if and only 
if Ran(T) is closed, dim(Ker(r)) < oo and dim(Ran(T)-'-) < oo. Its Fredholm index is then 
defined by Ind(T) = dim(Ker(T)) — dim(Ran(T)-'-). Recall also |Hal] that an operator T G B('H) 
is called bounded from below if there is a constant (7 > such that ||r0|| > g\\(t)\\ for all G "H. 
Then one can prove the following: T is invertible (as operator, that is, there exists a bounded 
inverse) if and only if T is bounded from below and Ran(T) is dense. Furthermore, T is said to be 
essentially bounded from below if there exists a constant (7 > such that T*T > gl except on a 
finite dimensional subspace. The following shows that this is connected to Fredholm properties. 

Proposition 39 All of the following statements are equivalent: 

(i) There exists g > such that T*T > gl except on a finite dimensional subspace 

(ii) ^ aUT*T) 

(iii) T*T is a Fredholm operator 

(iv) There is no singular Weyl sequence (0„)n>i of pairwise orthogonal unit vectors with T(pn 

(v) T is a left semi-Fredholm operator, namely Ran(T) is closed and dim(Ker(T)) < 00 

(vi) There exists S G ©("H) such that ST — 1 is compact {S is called a left pseudo-inverse) 

(vii) There exists S G B('H) such that T*S — 1 is compact 

(viii) T* is a right semi-Fredholm operator, namely Ran(r*) is closed and dim ( Ran (T*)-*-) < 00 
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Proof. The equivalence of (i) to (iv) can be found in any text book. Equivalence with (v) is 
|EEt Corollary 1.4.7] and with (vi) |EEl Theorem 1.3.13] (actually, it rather follows from the proof 
therein). Finally equivalence of (vi) with (vii) is |EEl Proposition 1.3.9] and with (viii) again the 
proof of [EE', Theorem 1.3.13], combined with |EEt Theorem 1.3.7] □ 

Corollary 4 T is a Fredholm operator if and only if T and T* are essentially bounded from 
below. 

Proposition 40 For a Fredholm operator T with Ind(T) = 0, one has ^ (^c{T) U (Jr{T). 

Proof. For a Fredholm operator with vanishing index there exists a compact operator K such 
that S = T + K is, invertible, namely ^ (y{S). Suppose that G crdT). Then there exists 
a singular Weyl sequence (0„)„>i of pairwise orthogonal unit vectors with T(f)n — )■ 0. But as 
K4>n ~^ 0, one also has S(pn and therefore G (y{S), which is a contradiction. Next 
recall that G (Jr{T) if and only if T has trivial kernel and Ran(r) is not dense, namely if 
dim(Ker(T)) = and dim(Ker(T*)) > 0. But these two properties are not reconcilable with 
Ind(T) = so that ^ cr,.(r). □ 

B Frames, angle spectrum and Fredholm pairs 

This appendix resembles a few definitions and known results about subspaces of a separable 
Hilbert space %. 

Definition 8 Let £ be a closed subspace of a Hilbert space "H of dimension k G NU{oo}. Denote 
£2 = £^({1, . . . ,k}). A frame for £ is an operator ^ : f Ti with £ = Ran($) and $*$ = 1. 
Then denotes a frame for £^ . 

If $ is a frame for £^ then $$* is obviously the orthogonal projection in H, on £. Note 
that frames are also partial isometrics. Clearly frames are not unique. The following definition 
naturally generalizes finite-dimensional notions. In fact, if and are two unit vectors, then 
the angle Q between them is given by cos(6')^ = l^*-;/^!^. 

Definition 9 Let £ and J- be two closed subspaces of a Hilbert space "H with frames $ and ^ 
respectively. Suppose dim.{£) > dim(J-'). Then the angle spectrum a {£, J-") C [0, |] between £ and 
T is given by the those 9 G [0, |] the cosine square of which are in the spectrum of (vl>)*<|)$*vl>; 

cos2(a(^,J^)) = ct((^)*$<I>*^) . 

The angle spectrum can be decomposed into point, singular and absolutely continuous spectrum 
as well as discrete and essential spectrum by using these notions for the self-adjoint operator 

(VI>)*<|)<|)*V[/. 
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Because for any operator T one has a(T*T) U {0} = a(TT*) U {0}, it follows that a{£,J-') U 
{^} = a{J-',S) U {|} in case that dim(£^) = dim(J-'). It is also possible to calculate the an- 
gle spectrum from the associated orthogonal projections. For example, if £ + J-" = Ti, then 
sm{a{£, T)) = cr($<l>* - ^^*) n M>. 

It is possible that the angle spectrum a{S,J^) between two closed subspaces is essential at 
so that there are infinitely many almost common directions. Then, even if is not in the 
point spectrum of a{S, J-") so that the intersection of the subspaces is empty as a set, one cannot 
speak of transversal subspaces. The following notion due to Kato [KatJ is to be interpreted as 
a transversality condition on two subspaces as well as their orthogonal complements up to finite 
dimensional intersections. 

Definition 10 Two closed subspaces S and of a Hilbert space % are said to form a Fredholm 
pair if the dimension of the intersection E r\T and the codimension of the sum 8 + are finite 
and, moreover, £ + is a closed subspace. Their index is then defined by 

md{S, J") = dim{S n - codim(f + J^) . 

Note that the closedness of S + T has to be assumed, in general. It does not follow from the 
closedness of £ and J-" unless one of the latter is finite dimensional. Note also that if, say, J-" is 
finite dimensional, then S has to span all but finitely many directions of "H if £^ and J-" form a 
Fredholm pair. One is, however, mainly interested in the case where both S and J-" are infinite 
dimensional. The above definition coincides with [Fur] . but in [ASSj S and J-" (or the associated 
orthogonal projections) are said to form a Fredholm pair if the dimension of the intersection 
S n J-"-*" and the codimension of the sum S + J-"-*" are finite and S + J-"-*" is closed. In view of the 
connections to the angles between the subspaces presented next, we stick to the above choice. 

Tiieorem 11 Let S and T he two closed subspaces and $ and ^ be frames for 8 and T . Then 
the following are equivalent: 

(i) £ and T form a Fredholm pair 

(ii) <|)*\I'-'- is a Fredholm operator 

(iii) The essential angle spectra a^^^{S,J^) and a^^^lS-^ , J-'-^) do not contain 

Proof. Let P = $($)* be the orthogonal projection on S and Q = vI>-'-(v[/-'-)* the orthogonal 
projection on J-"-*-. It is proved in |ASSl [Fur] that (i) is equivalent to the fact that QP seen as an 
operator from PH to QH is a Fredholm operator. But ^ : f PH and {^^)* : QH £^ are 
isomorphisms so that QP is Fredholm if and only if (\E'-'-)*(5P$ = (\E'-'-)*$ is Fredholm. For the 
equivalence (ii)-<=^(iii) let us recall that an operator T is Fredholm if and only if T*T and TT* 
are Fredholm, thus if and only if ^ (t,,,{T*T) and ^ a,,,(TT*). This is applied to T = <l>*^^. 
Hence (ii) is equivalent to 

and 

0^a...(<l>**^(^^)*$) = l-a...($*^^*<l>) ^ 0^a^4T,£). 
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But ^ a^^^(^J^,£) is equivalent to ^ a^^^{^£,J^) because these two angle spectra differ at most 
by the point |. □ 



Next let us recall that if "H = £^ + J-" is the sum of two closed subspaces with trivial intersection 
£ r\ = {0}, then there is an associated oblique projection (idempotent) defined by Pcj) = -0 if 
(j) = ij) + ip' with ip ^ £ and ijj' & T is the unique decomposition. The range of P is £, the kernel 
J-". The projection P is orthogonal if and only if £^ = J-"-*-. 



Proposition 41 Let £ and T be a Fredholm pair and let $ and he frames for £ and T . If 
n = £ + J^and£r\7 = {0}, then 



is the oblique projection {idempotent) on l-i with range Ran(P) = £ and kernel Ker(P) = J-". 

Proof. By Theorem [TT| the operator (^1'-'-)*$ is Fredholm and therefore Ran((\I'-'-)*$) is closed 
so that f = Ran((\E'-^)*$)©Ker($*\E'-^). Let us show that the kernel of $*v1>-L jg trivial. Indeed, if 
$*\E'-'-v = for some vector v, then "^-^v is perpendicular to £, thus "^^v G £-^r\J^-^ = {£ + J^)-^ = 
{0}, the last equality by the hypothesis Ti = £ + J', so that v = 0. Thus {^^)*^ : f f is 
surjective. To check the injectivity, suppose that {"^^y^v = 0. Then E £ (1 J-" so that v = 
by the hypothesis £ Cl = {0}. Hence is bijective and bounded and therefore invertible 

by the inverse mapping theorem. □ 

C Riesz projections 

The following proposition resembles a few facts about Riesz projections associated to a bounded 
operator T on a Hilbert space. Proofs can be found, e.g., in |Kat) . 

Proposition 42 Let A C (j{T) be a separated spectral subset, namely a closed subset which has 
trivial intersection with the closure of a{T) \ A. Associated to A let T be a curve in C\ cr(T) 
with winding number 1 around each point of A and around all points of a(T) \ A. The Riesz 
projection of T on A is defined as 



Range and kernel of P^ are denoted by £/\ = Ran(PA) cind J-'a = Ker(PA)- If ^ = {A} is an 
isolated point in cr{T), let us also use the notation P\ = Pa, £\ = £a o-nd so on. The following 
properties hold. 

(i) -Pa is idempotent, namely an oblique projection and£A andj^^ o.re closed subspaces. Moreover, 
Pa is independent of the choice ofV. 

(ii) IfT is invertible and iV)^'^ denotes the path of inversed complex points, one has 



p = $((^^)*$) ^{m^y 



(52) 




(53) 




(54) 
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(iii) If A and A' are disjoint separated spectral subsets, then PaPa' = and PauA' = -Pa + -Pa'- 

(iv) For is a disjoint decomposition a{T) = IJ^;^ A; in separated spectral subsets, Ylf=i Pa; = 1- 

(v) £a is invariant for T and J^a is invariant for T* . Moreover, dim(£^A) = dim(J-'_^). 

(vi) //$A and'^A are frames for £ a and J^^ anc? \1/^$a is invertible, then 

Pa = $A (n*A)-'^l . 

(vii) The orthogonal projections on Sa and Ta cli^g Pa Pa = '^'a'^'a '^'^^ PaP*a = ^a^a- 

(viii) //dim(£^A) < oo, then £\ is the span of the generalized eigenvectors ofT to A. 

(ix) Let f be an analytic function on the convex closure of a{T). Suppose that 

f{a{T) n A) n f{a{T) \ A) = . 

Denote by Q/(a) the Riesz projection of f{T) on /(A), which is a separated spectral subset 
for f{T). Then Qji^a) = Pa- 

D Analytic Fredholm theory 

This appendix is there to illustrate the difficulty linked to the stability of the essential spectrum 
of non-self-adjoint operators. The following criterion is extracted from the arguments in Section 
XIII.4 of |RSj . Examples that case (ii) below actually does appear are given in Section [6741 

Theorem 12 Let T and S be two bounded operators on some separable Hilbert space such that 
T — S is compact. Let C G C be one connected component of C\a{T) . Then one of the following 
two claims holds true: 

(i) C contains a point in the resolvent set of S. 

(ii) All points of C are eigenvalues of S. 

In the case (i), the spectrum of S in C is discrete. 

Proof. Let K = T — S. Then z E C ^ K{T — z)~^ is analytic and compact- valued. For 
z E C one has S — z = (1 — K{T — z)^^){T — z), so the inverse [S — z)~^ exists if and only if 
(1 — K[T — z)~^)~^ exists. Now one clearly has the dichotomy that either C contains some point 
in the resolvent set of S or it contains none. The ffist case corresponds to (i). Then there exists 
some Zo E C such that the inverse (1 — K{T — Zo)~^)~^ exists. But by the analytic Fredholm 
theorem [RS, Theorem VI.16], the inverse (1 — K{T — 2;)^^)^^ then exists for all 2; G C except for 
a discrete set of points. Hence also the spectrum of S lying in C only consists of a discrete set of 
points. In the second possibility, where no point of C lies in the resolvent set of S, the operator 
1 — K{T — is not invertible for any z G C. By the Fredholm alternative this implies that for 
each z E C there is a vector Vz lying in the kernel of 1 — K{T — z)^^. Setting Wz = {T — z)~^Vz, 
one then has (T — z)wz = Kwz, that is 5*^2 = zWz- Therefore in the second possibility all points 
z E C are eigenvalues of S. □ 
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E Spectral flow of paths of essentiaUy gapped unitaries 

For the convenience of the reader, some folklore facts about spectral flow are recollected in this 
appendix. Let V^ssi'H) be the set of those unitary operators -u on a Hilbert space "H with the 
property that 1 ^ ^"^^^(m). Such unitaries will be called essentially gapped. Associated to every 
(continuous) path 7 = {ut)te[to,ti] in Uess('H) one can now define the spectral flow SF(7) as the 
number of eigenvalue crossings through 1, weighted by the orientation of the crossing. For that 
purpose, let us first suppose that the number of crossings {t G [to,ti) \ 1 G <7{ut)} is finite 
and does not contain the initial point Iq. It is explained below that these transversality and 
boundary conditions can be considerably relaxed in a straightforward manner. At a crossing Ut 
with 1 G (j{ut), let e*^^'% . . . , e*^'-^ be those eigenvalues of the unitary Us which are all equal to 1 
at s = t. Let us choose them to be continuous in s and call the 9k.s G (— tt, tt] also the eigenphases 
of Ug. Choose e,d > such that 9k^s ^ [—S, 6] for k = 1, . . . ,1 and s G [t — e,t + e] and that there 
are no other eigenphases in [—6, 6] for s ^ t and finally 9k^s 7^ for those parameters. Let ?7,_ 
and n+ be the number of those of the / eigenphases less than respectively before and after the 
intersection, and similarly let p_ and p+ be the number of eigenphases larger than before and 
after the crossing. Then the signature of Ut is defined by 

sgn{ut) = ^ (p+ - n+ - p_ + = I - n+ - . (55) 

Note that — / < sgn(7f) < / and that sgn(7() is the effective number of eigenvalues that have 
crossed 1 in the counter-clock sense. Furthermore the signature is stable under perturbations of 
the path in the following sense: if a crossing is resolved by a perturbation into a series of crossings 
with lower degeneracy, then the sum of their signatures is equal to sgn('U(). Finally let us remark 
that, if the phases are differentiable and dt6k,t 7^ for A; = 1, . . . , /, then sgn(wt) is equal to the 
sum of the / signs sgn(9(^fc^(), k = 1, . . . , /. Yet another equivalent way to calculate sgn{ut) is 
as the signature of ^{ut)*dtUt seen as quadratic from on the eigenspace of Ut to the eigenvalue 1 
(again under the hypothesis that the form is non-degenerate). Now the spectral flow of the path 
7 is defined by 

SF(7) = J2 ^Sn{ut) , (56) 

t 

where the sum is over the finite number of points at which 1 G (7{ut). If the initial point Iq is 
on the singular cycle, but say the speeds of the eigenvalues passing through 1 are non- vanishing, 
the index can still be defined. In order to conserve an obvious concatenation property, only the 
initial point to in (156]) is included and not the final point ti (an alternative would be to give each 
a weight |). Furthermore, if a path 7 is such that 1 G cr{ut) for an interval of parameters t, but 
it is clearly distinguishable how many eigenvalues pass through 1 in the process, then the index 
can be defined as well. A formal, but obvious definition in these cases is not written out. It is 
clear from the definition that SF(7) is a homotopy invariant under homotopies keeping the end 
points of 7 fixed. 
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